[ 590.932018] env[69777]: INFO neutron.common.config [-] Logging enabled! [ 590.932018] env[69777]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43 [ 590.932018] env[69777]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69777) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 590.932018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 590.932018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 590.932579] env[69777]: WARNING oslo_policy.policy [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 590.932927] env[69777]: WARNING oslo_policy.policy [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 590.934546] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] VMware NSXv3 Agent initialized successfully. [ 590.935260] env[69777]: DEBUG oslo_concurrency.lockutils [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] Acquiring lock "singleton_lock" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.935260] env[69777]: DEBUG oslo_concurrency.lockutils [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] Acquired lock "singleton_lock" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.935812] env[69777]: DEBUG oslo_concurrency.lockutils [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] Releasing lock "singleton_lock" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.935812] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] Full set of CONF: {{(pid=69777) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 590.936170] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ******************************************************************************** {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 590.936170] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] Configuration options gathered from: {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 590.936547] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 590.936547] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 590.937308] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ================================================================================ {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 590.937308] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] agent_down_time = 75 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.937308] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] allow_automatic_dhcp_failover = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.937308] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] allow_bulk = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.937308] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] api_extensions_path = {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.937513] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] api_paste_config = api-paste.ini {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.937547] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] auth_strategy = keystone {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.937742] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] backdoor_port = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.937939] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] backdoor_socket = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.937939] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] backlog = 4096 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939023] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939023] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] bind_host = 0.0.0.0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939023] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] bind_port = 9696 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939023] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] client_socket_timeout = 900 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939023] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] config_dir = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939023] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939232] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] config_source = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939232] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] control_exchange = neutron {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939232] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] core_plugin = ml2 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939310] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] debug = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939639] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] default_availability_zones = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939639] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.939829] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] dhcp_agent_notification = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.940069] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] dhcp_agents_per_network = 1 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.940069] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] dhcp_lease_duration = 86400 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.940604] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] dhcp_load_type = networks {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.940604] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] dns_domain = openstacklocal {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.940604] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.941074] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] enable_default_route_bfd = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.941074] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] enable_default_route_ecmp = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.941074] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] enable_dvr = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.941074] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] enable_new_agents = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.941738] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.941738] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] enable_signals = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.941738] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] enable_traditional_dhcp = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.941738] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] external_dns_driver = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.941738] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] filter_validation = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.942356] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] global_physnet_mtu = 8950 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.942356] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] graceful_shutdown_timeout = 60 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.942356] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] host = cpu-1 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.942356] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] host_dvr_for_dhcp = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.942460] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] http_retries = 3 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.942847] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] instance_format = [instance: %(uuid)s] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.942847] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.942847] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ipam_driver = internal {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.942985] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ipv6_pd_enabled = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.943091] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] l3_ha = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.943223] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.943584] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] l3_ha_network_physical_name = {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.943584] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] l3_ha_network_type = {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.943675] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] log_color = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.943776] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] log_config_append = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.944019] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.944131] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] log_dir = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.944287] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] log_file = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.944287] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] log_options = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.944735] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] log_rotate_interval = 1 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.944735] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] log_rotate_interval_type = days {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.944735] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] log_rotation_type = none {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.944857] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.944958] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.945090] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946184] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946184] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946184] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] max_dns_nameservers = 5 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946184] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] max_header_line = 16384 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946184] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] max_l3_agents_per_router = 3 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946184] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] max_logfile_count = 30 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946581] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] max_logfile_size_mb = 200 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946581] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] max_subnet_host_routes = 20 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946581] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] my_ip = 10.180.1.21 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946581] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] my_ipv6 = ::1 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946751] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] network_auto_schedule = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946751] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] network_link_prefix = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.946896] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.947016] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] notify_nova_on_port_data_changes = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.947156] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] notify_nova_on_port_status_changes = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.947297] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] pagination_max_limit = -1 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.947434] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] publish_errors = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948246] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] rate_limit_burst = 0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948246] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] rate_limit_except_level = CRITICAL {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948246] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] rate_limit_interval = 0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948246] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] retry_until_window = 30 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948246] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] router_distributed = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948246] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] rpc_resources_processing_step = 20 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948446] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] rpc_response_max_timeout = 600 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948540] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] rpc_response_timeout = 60 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948662] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] send_events_interval = 2 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948814] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] service_plugins = ['router'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.948957] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] setproctitle = on {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.949503] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] shell_completion = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.949503] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] state_path = /opt/stack/data/neutron {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.949503] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] syslog_log_facility = LOG_USER {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.949674] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] tcp_keepidle = 600 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.949674] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] transport_url = **** {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.949825] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] use_journal = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.949915] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] use_json = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.950096] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] use_ssl = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.950190] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] use_stderr = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.951104] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] use_syslog = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.951104] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] vlan_qinq = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.951104] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] vlan_transparent = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.951104] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] watch_log_file = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.951104] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] wsgi_default_pool_size = 100 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.951104] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] wsgi_keep_alive = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.951293] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.951293] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] wsgi_server_debug = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 590.951446] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_concurrency.disable_process_locking = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.951562] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.951982] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.951982] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.951982] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.952206] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.952296] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.952617] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.connection_string = messaging:// {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.952617] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.enabled = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.952753] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.es_doc_type = notification {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.952875] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.es_scroll_size = 10000 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.953030] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.es_scroll_time = 2m {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.953175] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.filter_error_trace = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.953564] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.hmac_keys = **** {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.953564] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.sentinel_service_name = mymaster {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.953639] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.socket_timeout = 0.1 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.954392] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.trace_requests = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.954392] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler.trace_sqlalchemy = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.954392] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler_jaeger.process_tags = {} {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.954392] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler_jaeger.service_name_prefix = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.954392] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] profiler_otlp.service_name_prefix = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.954693] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.enforce_new_defaults = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.954727] env[69777]: WARNING oslo_config.cfg [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 590.954874] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.enforce_scope = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.955032] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.policy_default_rule = default {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.955286] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.955891] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.955891] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958429] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958429] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958429] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958429] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958429] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958429] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958611] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] agent.extensions = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958611] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958611] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] service_providers.service_provider = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958611] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.default_quota = -1 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958611] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958611] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.quota_floatingip = 50 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958759] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.quota_network = 100 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958759] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.quota_port = 500 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958759] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958759] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.quota_router = 10 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958759] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.quota_security_group = 10 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958759] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958759] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.quota_subnet = 100 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958937] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] QUOTAS.track_quota_usage = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.958963] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.959145] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep.group = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.959250] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep.helper_command = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.959393] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.959535] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep.thread_pool_size = 8 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.959672] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep.user = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.959830] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.959951] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_dhcp_release.group = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.960707] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_dhcp_release.helper_command = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.960707] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.960707] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.960707] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_dhcp_release.user = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.960707] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.960917] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_ovs_vsctl.group = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.960917] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.961099] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.961198] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.961333] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_ovs_vsctl.user = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.961482] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_namespace.capabilities = [21] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.961618] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_namespace.group = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.961757] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_namespace.helper_command = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.961901] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.962055] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.962198] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_namespace.user = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.962350] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_conntrack.capabilities = [12] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.962492] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_conntrack.group = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.962631] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_conntrack.helper_command = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.962775] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.962919] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.963070] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_conntrack.user = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.963225] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_link.capabilities = [12, 21] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.963365] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_link.group = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.963502] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_link.helper_command = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.963647] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.963788] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_link.thread_pool_size = 8 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.963924] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] privsep_link.user = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.964094] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.964249] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.964395] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.continue_on_failed_promotions = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.964535] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.dscp = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.964680] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.dscp_inherit = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.964828] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.force_mp_to_policy = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.964969] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.locking_coordinator_url = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.965144] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.log_agent_heartbeats = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.965294] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.logging_expire = 1 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.965446] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.965592] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.965743] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.polling_interval = 240 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.965890] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.966073] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.966245] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.report_interval = 30.0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.966403] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.966555] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.966706] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.966853] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.sync_skew = 60 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.966999] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.synchronization_queue_size = 20 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.967162] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT.use_helper_for_ns_read = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.967313] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] SECURITYGROUP.enable_ipset = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.967464] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] SECURITYGROUP.enable_security_group = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.967616] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.967766] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.967916] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] experimental.ipv6_pd_enabled = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.968094] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ml2.extension_drivers = ['port_security'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.968247] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ml2.external_network_type = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.968409] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.968565] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ml2.overlay_ip_version = 4 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.968718] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ml2.path_mtu = 8950 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.968872] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ml2.physical_network_mtus = {} {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.969485] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.969485] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.969485] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ml2.type_drivers = ['vlan'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.969485] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.969691] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.969785] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.969929] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.970094] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.970253] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.970405] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.970554] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.970760] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.970891] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.971055] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_login_password = **** {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.971212] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.971366] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_login_user = admin {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.971521] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.971671] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.971819] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.971966] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.972133] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.972295] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.972445] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.972598] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.972746] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.972898] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.973063] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.973210] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.973363] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.973553] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.973712] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.973865] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.974033] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.974196] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.auth_section = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.974356] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.auth_type = password {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.974508] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.974654] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.certfile = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.974799] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.collect_timing = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.974952] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.endpoint_type = public {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.975136] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.insecure = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.975284] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.keyfile = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.975441] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.region_name = RegionOne {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.975597] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.split_loggers = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.975738] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] nova.timeout = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.975889] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.auth_section = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.976057] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.auth_type = password {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.976239] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.976387] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.certfile = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.976534] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.collect_timing = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.976688] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.endpoint_type = public {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.976833] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.insecure = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.976975] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.keyfile = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.977128] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.region_name = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.977274] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.split_loggers = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.977417] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] placement.timeout = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.977568] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.auth_section = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.977714] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.auth_type = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.977857] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.cafile = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.977999] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.certfile = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.978184] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.collect_timing = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.978346] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.connect_retries = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.978493] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.connect_retry_delay = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.978638] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.enable_notifications = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.978780] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.endpoint_override = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.978926] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.insecure = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.979078] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.interface = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.979225] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.keyfile = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.979366] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.max_version = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.979508] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.min_version = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.979649] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.region_name = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.979790] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.retriable_status_codes = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.979930] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.service_name = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.980081] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.service_type = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.980235] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.split_loggers = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.980380] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.status_code_retries = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.980523] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.status_code_retry_delay = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.980664] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.timeout = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.980849] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.valid_interfaces = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.980979] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ironic.version = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.981102] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] cli_script.dry_run = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.981262] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.981409] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.981574] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.981700] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.981842] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.981986] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.982144] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.982292] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.982434] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.982589] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.982731] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.982897] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.983038] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.983193] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.983341] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.983492] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.983637] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.983782] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.983933] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.984092] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.984239] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.984392] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.984537] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.984683] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.984828] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.984973] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.985153] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.985305] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.985452] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.985602] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.985743] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.ssl = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.985896] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.986061] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.986518] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.986518] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.986518] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.986648] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.986797] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_notifications.driver = [] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.986946] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_notifications.retry = -1 {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.987119] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.987264] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 590.987377] env[69777]: DEBUG oslo_service.backend.eventlet.service [None req-2174ffd0-297c-4575-87da-bb261cb52184 None None] ******************************************************************************** {{(pid=69777) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 590.988324] env[69777]: DEBUG neutron.agent.securitygroups_rpc [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Init firewall settings (driver=nsxv3) {{(pid=69777) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 590.989549] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69777) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 590.989788] env[69777]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] RPC agent_id: nsxm-l-01a.corp.local [ 590.991949] env[69777]: DEBUG dogpile.cache.region [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 590.992092] env[69777]: DEBUG dogpile.lock [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 590.992197] env[69777]: DEBUG dogpile.lock [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 590.992316] env[69777]: DEBUG dogpile.lock [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 590.992384] env[69777]: DEBUG dogpile.cache.region [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 590.992474] env[69777]: DEBUG dogpile.lock [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 590.992597] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.023186] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Session token - acquiring [ 591.024674] env[69777]: DEBUG networking_nsxv3.common.locking [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.024861] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.024951] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.025434] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.035136] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.325255] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 591.347283] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.347516] env[69777]: DEBUG dogpile.cache.region [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Cache value generated in 0.355 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 591.347707] env[69777]: DEBUG dogpile.lock [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.347844] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Activating Policy API Provider. [ 591.348076] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Looking for the default Infrastructure Rules. [ 591.412968] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Looking for the Default Layer3 Logged Drop Section. [ 591.425883] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 591.426294] env[69777]: DEBUG networking_nsxv3.common.locking [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.426466] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquiring lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.426571] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.426840] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired external semaphore "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.427227] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.942298] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.444277] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.946320] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Inventory metadata is going to be refreshed. [ 592.946733] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 593.642981] env[69777]: DEBUG networking_nsxv3.common.locking [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.643237] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.643348] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.643647] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.755074] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 593.756016] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.756947] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 593.772818] env[69777]: DEBUG networking_nsxv3.common.locking [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.773046] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.773123] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.773372] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.773491] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.773634] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 593.773748] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 593.773855] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 593.791679] env[69777]: DEBUG networking_nsxv3.common.locking [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.791838] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.791942] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.792224] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.792394] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.792532] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 593.811040] env[69777]: DEBUG networking_nsxv3.common.locking [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.811203] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.811340] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.811617] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.811756] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.811898] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 593.827889] env[69777]: DEBUG networking_nsxv3.common.locking [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.828056] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquiring lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.828171] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.828457] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired external semaphore "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.828595] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Releasing lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.828740] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 593.828849] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 593.828957] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 593.845588] env[69777]: DEBUG networking_nsxv3.common.locking [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.845846] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquiring lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.845846] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.846143] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired external semaphore "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.846270] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Releasing lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.846416] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 593.846525] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 593.846634] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 593.863296] env[69777]: DEBUG networking_nsxv3.common.locking [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.863458] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.863554] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.863816] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.863949] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.864112] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 593.864222] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 593.864324] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Inventory metadata have been refreshed. [ 593.864423] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Dryrun:True. Metadata refresh completed. [ 593.864543] env[69777]: DEBUG oslo_concurrency.lockutils [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Releasing lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.866297] env[69777]: INFO neutron.agent.agent_extensions_manager [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Loaded agent extensions: [] [ 593.866999] env[69777]: DEBUG neutron_lib.callbacks.manager [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69777) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 593.925443] env[69777]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] NSXv3 Agent Agent RPC Daemon Started! [ 593.925583] env[69777]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] NSXv3 Agent Agent loop - iteration:0 started [ 593.925620] env[69777]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] NSXv3 Agent Agent out of sync with plugin! [ 598.868366] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 598.868366] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 603.869866] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 603.870277] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 607.773711] env[69777]: INFO networking_nsxv3.common.synchronization [None req-c701c11a-89f7-4689-8def-d59ef4483877 demo admin] Enqueued Resource ID: 864a7a37-9092-478d-9747-616b63f5d3e5 with Priority: HIGHEST for action security_group_rules [ 607.774254] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864a7a37-9092-478d-9747-616b63f5d3e5 with Priority: HIGHEST for action security_group_rules [ 607.774552] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-864a7a37-9092-478d-9747-616b63f5d3e5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.774679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-864a7a37-9092-478d-9747-616b63f5d3e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.774745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-864a7a37-9092-478d-9747-616b63f5d3e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.775138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-864a7a37-9092-478d-9747-616b63f5d3e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.775242] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('864a7a37-9092-478d-9747-616b63f5d3e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.294404] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.294665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.294743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.295014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.295168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.295348] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 864a7a37-9092-478d-9747-616b63f5d3e5 already deleted. [ 608.295463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-864a7a37-9092-478d-9747-616b63f5d3e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.775427] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 612.775427] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 617.777501] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 617.777501] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 622.778270] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 622.778632] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 627.779894] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 627.780255] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 632.780841] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 632.781180] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 637.782350] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 637.782350] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 638.976045] env[69777]: INFO networking_nsxv3.common.synchronization [None req-cf839418-fb75-48d9-b191-4f4e98243b1b None None] Enqueued Resource ID: ad4f503c-7bb5-4cae-ae4e-19363b5c054e with Priority: HIGHEST for action port [ 638.976294] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad4f503c-7bb5-4cae-ae4e-19363b5c054e with Priority: HIGHEST for action port [ 638.976789] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad4f503c-7bb5-4cae-ae4e-19363b5c054e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.976914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad4f503c-7bb5-4cae-ae4e-19363b5c054e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.976974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad4f503c-7bb5-4cae-ae4e-19363b5c054e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.981436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad4f503c-7bb5-4cae-ae4e-19363b5c054e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.981535] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad4f503c-7bb5-4cae-ae4e-19363b5c054e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.488810] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad4f503c-7bb5-4cae-ae4e-19363b5c054e [ 639.488810] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.488810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.488810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.488810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.488810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.488810] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad4f503c-7bb5-4cae-ae4e-19363b5c054e already deleted. [ 639.488810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad4f503c-7bb5-4cae-ae4e-19363b5c054e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.049908] env[69777]: INFO networking_nsxv3.common.synchronization [None req-d0efdb10-3850-457a-8603-a431513dfc16 None None] Enqueued Resource ID: aab540a3-784b-46de-a7ce-bf5ba66603af with Priority: HIGHEST for action port [ 640.050391] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aab540a3-784b-46de-a7ce-bf5ba66603af with Priority: HIGHEST for action port [ 640.052431] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-aab540a3-784b-46de-a7ce-bf5ba66603af taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.052431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aab540a3-784b-46de-a7ce-bf5ba66603af" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.052431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aab540a3-784b-46de-a7ce-bf5ba66603af" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.055318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aab540a3-784b-46de-a7ce-bf5ba66603af" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.055318] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aab540a3-784b-46de-a7ce-bf5ba66603af',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.188065] env[69777]: INFO networking_nsxv3.common.synchronization [None req-f51a8dfb-be02-4b8f-a2fc-4cafa20fdeca None None] Enqueued Resource ID: cc0716cd-ea9b-40da-ab74-1008ccabc384 with Priority: HIGHEST for action port [ 640.188165] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0716cd-ea9b-40da-ab74-1008ccabc384 with Priority: HIGHEST for action port [ 640.188717] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc0716cd-ea9b-40da-ab74-1008ccabc384 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.189327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc0716cd-ea9b-40da-ab74-1008ccabc384" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.189327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc0716cd-ea9b-40da-ab74-1008ccabc384" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.189327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc0716cd-ea9b-40da-ab74-1008ccabc384" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.192681] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc0716cd-ea9b-40da-ab74-1008ccabc384',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.556727] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aab540a3-784b-46de-a7ce-bf5ba66603af [ 640.556727] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.556727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.556727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.556975] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.557192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.557192] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aab540a3-784b-46de-a7ce-bf5ba66603af already deleted. [ 640.557365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aab540a3-784b-46de-a7ce-bf5ba66603af" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.695675] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc0716cd-ea9b-40da-ab74-1008ccabc384 [ 640.695675] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.695675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.695675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.695936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.696044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.696143] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc0716cd-ea9b-40da-ab74-1008ccabc384 already deleted. [ 640.696225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc0716cd-ea9b-40da-ab74-1008ccabc384" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.315694] env[69777]: INFO networking_nsxv3.common.synchronization [None req-e7ec8035-0217-4886-b327-d724834dff55 None None] Enqueued Resource ID: 9c872e8c-84cf-4f6b-af6a-70b880948d49 with Priority: HIGHEST for action port [ 641.315694] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c872e8c-84cf-4f6b-af6a-70b880948d49 with Priority: HIGHEST for action port [ 641.315694] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c872e8c-84cf-4f6b-af6a-70b880948d49 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.315694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c872e8c-84cf-4f6b-af6a-70b880948d49" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.315694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c872e8c-84cf-4f6b-af6a-70b880948d49" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.315694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c872e8c-84cf-4f6b-af6a-70b880948d49" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.315694] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c872e8c-84cf-4f6b-af6a-70b880948d49',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.387168] env[69777]: INFO networking_nsxv3.common.synchronization [None req-6aceb756-545a-4c62-b8da-2c1db99a99b0 None None] Enqueued Resource ID: 796316d5-d790-4ef8-bbf5-7b398a73cf31 with Priority: HIGHEST for action port [ 641.388165] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796316d5-d790-4ef8-bbf5-7b398a73cf31 with Priority: HIGHEST for action port [ 641.388601] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-796316d5-d790-4ef8-bbf5-7b398a73cf31 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.389318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-796316d5-d790-4ef8-bbf5-7b398a73cf31" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.389318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-796316d5-d790-4ef8-bbf5-7b398a73cf31" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.389936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-796316d5-d790-4ef8-bbf5-7b398a73cf31" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.389936] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('796316d5-d790-4ef8-bbf5-7b398a73cf31',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.817385] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c872e8c-84cf-4f6b-af6a-70b880948d49 [ 641.817819] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.817819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.817819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.818106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.818106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.818342] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c872e8c-84cf-4f6b-af6a-70b880948d49 already deleted. [ 641.818342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c872e8c-84cf-4f6b-af6a-70b880948d49" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.894107] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 796316d5-d790-4ef8-bbf5-7b398a73cf31 [ 641.894447] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.895551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.895551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.895551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.895551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.895551] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:796316d5-d790-4ef8-bbf5-7b398a73cf31 already deleted. [ 641.895551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-796316d5-d790-4ef8-bbf5-7b398a73cf31" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.937654] env[69777]: INFO networking_nsxv3.common.synchronization [None req-dbb1673c-766a-48c1-8914-0f91754151da None None] Enqueued Resource ID: 358dd042-77b5-4e08-9bfb-801b2754acb7 with Priority: HIGHEST for action port [ 641.937918] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 358dd042-77b5-4e08-9bfb-801b2754acb7 with Priority: HIGHEST for action port [ 641.939887] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-358dd042-77b5-4e08-9bfb-801b2754acb7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.939992] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-358dd042-77b5-4e08-9bfb-801b2754acb7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.939992] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-358dd042-77b5-4e08-9bfb-801b2754acb7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.940686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-358dd042-77b5-4e08-9bfb-801b2754acb7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.940779] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('358dd042-77b5-4e08-9bfb-801b2754acb7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.243851] env[69777]: INFO networking_nsxv3.common.synchronization [None req-cf482142-cb36-41ea-98d7-882e80b13cf9 None None] Enqueued Resource ID: 3c550084-7f2d-4550-a471-69d613d3df66 with Priority: HIGHEST for action port [ 642.243912] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c550084-7f2d-4550-a471-69d613d3df66 with Priority: HIGHEST for action port [ 642.244455] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c550084-7f2d-4550-a471-69d613d3df66 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.244626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c550084-7f2d-4550-a471-69d613d3df66" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.244669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c550084-7f2d-4550-a471-69d613d3df66" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.244881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c550084-7f2d-4550-a471-69d613d3df66" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.246166] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c550084-7f2d-4550-a471-69d613d3df66',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.443706] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 358dd042-77b5-4e08-9bfb-801b2754acb7 [ 642.443964] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.444428] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.444428] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.444428] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.444855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.444855] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:358dd042-77b5-4e08-9bfb-801b2754acb7 already deleted. [ 642.444855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-358dd042-77b5-4e08-9bfb-801b2754acb7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.749751] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c550084-7f2d-4550-a471-69d613d3df66 [ 642.749839] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.750401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.750401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.750401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.750401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.750556] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c550084-7f2d-4550-a471-69d613d3df66 already deleted. [ 642.750556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c550084-7f2d-4550-a471-69d613d3df66" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.008315] env[69777]: INFO networking_nsxv3.common.synchronization [None req-da12d6b1-05dd-46d6-9ca3-bc4b1ebe0892 None None] Enqueued Resource ID: a9c216f3-1c53-4721-829b-64786093ed7b with Priority: HIGHEST for action port [ 643.008845] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c216f3-1c53-4721-829b-64786093ed7b with Priority: HIGHEST for action port [ 643.009163] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9c216f3-1c53-4721-829b-64786093ed7b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.009285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9c216f3-1c53-4721-829b-64786093ed7b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.009366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9c216f3-1c53-4721-829b-64786093ed7b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.009937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9c216f3-1c53-4721-829b-64786093ed7b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.009937] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9c216f3-1c53-4721-829b-64786093ed7b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.514914] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9c216f3-1c53-4721-829b-64786093ed7b [ 643.515271] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.515397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.515454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.515623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.515710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.515832] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9c216f3-1c53-4721-829b-64786093ed7b already deleted. [ 643.515915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9c216f3-1c53-4721-829b-64786093ed7b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.776964] env[69777]: INFO networking_nsxv3.common.synchronization [None req-0d706633-bca0-47f9-b873-d53369481654 None None] Enqueued Resource ID: a6212348-e7c9-46a1-a77d-79a4c4e5e098 with Priority: HIGHEST for action port [ 643.779564] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6212348-e7c9-46a1-a77d-79a4c4e5e098 with Priority: HIGHEST for action port [ 643.780079] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6212348-e7c9-46a1-a77d-79a4c4e5e098 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.780654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6212348-e7c9-46a1-a77d-79a4c4e5e098" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.780803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6212348-e7c9-46a1-a77d-79a4c4e5e098" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.781112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6212348-e7c9-46a1-a77d-79a4c4e5e098" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.781392] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6212348-e7c9-46a1-a77d-79a4c4e5e098',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.283965] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6212348-e7c9-46a1-a77d-79a4c4e5e098 [ 644.284224] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.284364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.284437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.284731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.284731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.284838] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6212348-e7c9-46a1-a77d-79a4c4e5e098 already deleted. [ 644.284946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6212348-e7c9-46a1-a77d-79a4c4e5e098" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.869696] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.869960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.869991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.870212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.870445] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.937134] env[69777]: INFO networking_nsxv3.common.synchronization [None req-c691d2f7-6841-4500-b23e-c522aa4cb878 None None] Enqueued Resource ID: 9f26c3fc-05db-4366-8ebb-853220a3c4fb with Priority: HIGHEST for action port [ 644.937134] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f26c3fc-05db-4366-8ebb-853220a3c4fb with Priority: HIGHEST for action port [ 644.937134] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f26c3fc-05db-4366-8ebb-853220a3c4fb taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.937134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f26c3fc-05db-4366-8ebb-853220a3c4fb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.937134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f26c3fc-05db-4366-8ebb-853220a3c4fb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.937836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f26c3fc-05db-4366-8ebb-853220a3c4fb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.938037] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f26c3fc-05db-4366-8ebb-853220a3c4fb',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.373882] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.441550] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f26c3fc-05db-4366-8ebb-853220a3c4fb [ 645.441550] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.441550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.441550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.441550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.441550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.441550] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f26c3fc-05db-4366-8ebb-853220a3c4fb already deleted. [ 645.441550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f26c3fc-05db-4366-8ebb-853220a3c4fb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.878973] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.250795] env[69777]: INFO networking_nsxv3.common.synchronization [None req-2199659d-97c1-4931-9e20-786f152c5f88 None None] Enqueued Resource ID: 8faca748-44dc-4f83-b75e-89428353dd58 with Priority: HIGHEST for action port [ 646.251512] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8faca748-44dc-4f83-b75e-89428353dd58 with Priority: HIGHEST for action port [ 646.251882] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-8faca748-44dc-4f83-b75e-89428353dd58 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.252074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8faca748-44dc-4f83-b75e-89428353dd58" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.252135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8faca748-44dc-4f83-b75e-89428353dd58" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.252367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8faca748-44dc-4f83-b75e-89428353dd58" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.252454] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8faca748-44dc-4f83-b75e-89428353dd58',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.386166] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 646.386166] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 646.416498] env[69777]: INFO networking_nsxv3.common.synchronization [None req-b60e1059-6383-48de-b0ea-689494177001 None None] Enqueued Resource ID: d0a194c6-d7b2-45d3-b896-67bf2269bb07 with Priority: HIGHEST for action port [ 646.416598] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a194c6-d7b2-45d3-b896-67bf2269bb07 with Priority: HIGHEST for action port [ 646.419388] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0a194c6-d7b2-45d3-b896-67bf2269bb07 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.419388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0a194c6-d7b2-45d3-b896-67bf2269bb07" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.419388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0a194c6-d7b2-45d3-b896-67bf2269bb07" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.419388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0a194c6-d7b2-45d3-b896-67bf2269bb07" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.419388] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a194c6-d7b2-45d3-b896-67bf2269bb07',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.756083] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8faca748-44dc-4f83-b75e-89428353dd58 [ 646.756337] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.756517] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.756587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.756929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.757009] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.757093] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8faca748-44dc-4f83-b75e-89428353dd58 already deleted. [ 646.757168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8faca748-44dc-4f83-b75e-89428353dd58" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.920239] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0a194c6-d7b2-45d3-b896-67bf2269bb07 [ 646.921159] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.921341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.921412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.921622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.921709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.921802] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0a194c6-d7b2-45d3-b896-67bf2269bb07 already deleted. [ 646.922171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0a194c6-d7b2-45d3-b896-67bf2269bb07" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.127746] env[69777]: INFO networking_nsxv3.common.synchronization [None req-456f7a30-7123-4cb1-ad08-e29a0c20f600 None None] Enqueued Resource ID: d860c49a-1cef-4651-8130-8943885dc44c with Priority: HIGHEST for action port [ 647.129498] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d860c49a-1cef-4651-8130-8943885dc44c with Priority: HIGHEST for action port [ 647.130055] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d860c49a-1cef-4651-8130-8943885dc44c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.130365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d860c49a-1cef-4651-8130-8943885dc44c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.130570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d860c49a-1cef-4651-8130-8943885dc44c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.131033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d860c49a-1cef-4651-8130-8943885dc44c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.131220] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d860c49a-1cef-4651-8130-8943885dc44c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.160610] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.160800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.160862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.161070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.174805] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 647.175077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.176229] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 647.196609] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.196609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.196609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.196609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.196609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.196609] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 647.196609] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 647.196609] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 647.220251] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.223911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.223911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.223911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.223911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.223911] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 647.246909] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.246909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.247038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.247814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.247814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.247814] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 647.268987] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.268987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.268987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.268987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.268987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.268987] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 647.269257] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 647.269257] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 647.288143] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.288297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.288297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.288862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.288862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.288862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 647.288862] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 647.288862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 647.307574] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.307574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.307574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.308736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.308736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.308736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 647.308736] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 647.308736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 647.308736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 647.308736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 647.308736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 647.308736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 647.308736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 647.308736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 647.308736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 647.326736] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.326736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.326859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.327011] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.327224] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.327224] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 647.348418] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.348704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.348704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.348830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.348929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.360843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.636977] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d860c49a-1cef-4651-8130-8943885dc44c [ 647.637246] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.637379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.637466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.637680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.637825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.637862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d860c49a-1cef-4651-8130-8943885dc44c already deleted. [ 647.638024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d860c49a-1cef-4651-8130-8943885dc44c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.919419] env[69777]: INFO networking_nsxv3.common.synchronization [None req-89f7d9dc-3da7-4ba4-92cd-30eb59c2d56c None None] Enqueued Resource ID: 9444646b-8e47-42f5-b79c-2a706a7fc106 with Priority: HIGHEST for action port [ 649.919670] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9444646b-8e47-42f5-b79c-2a706a7fc106 with Priority: HIGHEST for action port [ 649.919937] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9444646b-8e47-42f5-b79c-2a706a7fc106 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.920381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9444646b-8e47-42f5-b79c-2a706a7fc106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.920476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9444646b-8e47-42f5-b79c-2a706a7fc106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.920924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9444646b-8e47-42f5-b79c-2a706a7fc106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.921021] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9444646b-8e47-42f5-b79c-2a706a7fc106',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.107985] env[69777]: INFO networking_nsxv3.common.synchronization [None req-103a86b6-c3e0-4eab-bb09-d8d283311a72 None None] Enqueued Resource ID: c383fd71-23e0-4a36-b3cc-a64ddbaee85e with Priority: HIGHEST for action port [ 650.108291] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c383fd71-23e0-4a36-b3cc-a64ddbaee85e with Priority: HIGHEST for action port [ 650.108817] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-c383fd71-23e0-4a36-b3cc-a64ddbaee85e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.108944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c383fd71-23e0-4a36-b3cc-a64ddbaee85e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.109010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c383fd71-23e0-4a36-b3cc-a64ddbaee85e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.109267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c383fd71-23e0-4a36-b3cc-a64ddbaee85e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.109355] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c383fd71-23e0-4a36-b3cc-a64ddbaee85e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.424168] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9444646b-8e47-42f5-b79c-2a706a7fc106 [ 650.424301] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.424433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.424515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.424711] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.424799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.424891] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9444646b-8e47-42f5-b79c-2a706a7fc106 already deleted. [ 650.424973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9444646b-8e47-42f5-b79c-2a706a7fc106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.611798] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c383fd71-23e0-4a36-b3cc-a64ddbaee85e [ 650.612061] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.612175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.612752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.612752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.612752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.612752] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c383fd71-23e0-4a36-b3cc-a64ddbaee85e already deleted. [ 650.612752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c383fd71-23e0-4a36-b3cc-a64ddbaee85e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.832493] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a55296a0-a3dd-476c-b8c9-c7480ae2ae55 None None] Enqueued Resource ID: 0ffe5ae7-2dc5-4d79-9cc5-bb3a02185676 with Priority: HIGHEST for action port [ 650.832955] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5ae7-2dc5-4d79-9cc5-bb3a02185676 with Priority: HIGHEST for action port [ 650.833746] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ffe5ae7-2dc5-4d79-9cc5-bb3a02185676 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.834164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ffe5ae7-2dc5-4d79-9cc5-bb3a02185676" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.834319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ffe5ae7-2dc5-4d79-9cc5-bb3a02185676" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.834843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ffe5ae7-2dc5-4d79-9cc5-bb3a02185676" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.835088] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ffe5ae7-2dc5-4d79-9cc5-bb3a02185676',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.227248] env[69777]: INFO networking_nsxv3.common.synchronization [None req-aa536582-8534-4f95-a488-064832aaf300 None None] Enqueued Resource ID: 1c8bad49-29dd-4915-80ae-c8e405b146de with Priority: HIGHEST for action port [ 651.227528] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8bad49-29dd-4915-80ae-c8e405b146de with Priority: HIGHEST for action port [ 651.228106] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c8bad49-29dd-4915-80ae-c8e405b146de taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.228219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c8bad49-29dd-4915-80ae-c8e405b146de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.228289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c8bad49-29dd-4915-80ae-c8e405b146de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.228527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c8bad49-29dd-4915-80ae-c8e405b146de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.228756] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c8bad49-29dd-4915-80ae-c8e405b146de',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.338454] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ffe5ae7-2dc5-4d79-9cc5-bb3a02185676 [ 651.338851] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.339060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.339170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.339351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.339562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.339562] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ffe5ae7-2dc5-4d79-9cc5-bb3a02185676 already deleted. [ 651.339663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ffe5ae7-2dc5-4d79-9cc5-bb3a02185676" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.730867] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c8bad49-29dd-4915-80ae-c8e405b146de [ 651.731360] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.731590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.731673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.731843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.731938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.732065] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c8bad49-29dd-4915-80ae-c8e405b146de already deleted. [ 651.732148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c8bad49-29dd-4915-80ae-c8e405b146de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.164096] env[69777]: INFO networking_nsxv3.common.synchronization [req-e006f71a-0c5c-45c5-81e3-3a66bb007e54 req-4dbe4862-29a2-405f-9d9b-c6ad27cdb619 tempest-DeleteServersAdminTestJSON-1268258336 tempest-DeleteServersAdminTestJSON-1268258336-project-member] Enqueued Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 652.165655] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 652.165655] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.165655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.165655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.165655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.165655] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.165655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.165655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.165962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.165962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.165962] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.672320] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.672660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.672660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.673335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.673335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.673750] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.673878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.673927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.674118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.674197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.674282] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 already deleted. [ 652.674363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.879967] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.880198] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.880328] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.880655] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.880903] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.881073] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.881192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.881410] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.881611] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.881842] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.881958] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.882136] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.882265] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.882310] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.882424] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.882547] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.902601] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.902601] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 652.902601] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.902755] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.903089] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-73db8238-f7e8-406c-86e5-f7bf7663e1ec taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.904137] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-73db8238-f7e8-406c-86e5-f7bf7663e1ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.904137] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-73db8238-f7e8-406c-86e5-f7bf7663e1ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.904368] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-73db8238-f7e8-406c-86e5-f7bf7663e1ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.904453] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73db8238-f7e8-406c-86e5-f7bf7663e1ec',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.408301] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.408301] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.408301] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.410047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.410047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.410047] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 73db8238-f7e8-406c-86e5-f7bf7663e1ec not found, creating... [ 653.410047] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.410047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.410047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.410047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.410047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.410047] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.410355] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.410355] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.410506] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.410596] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.410730] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 73db8238-f7e8-406c-86e5-f7bf7663e1ec is going to be created. [ 653.431957] env[69777]: INFO networking_nsxv3.common.synchronization [req-b540d93c-d9b6-44bf-a68e-fa0191f5a4d8 req-cad83a08-7142-407f-94bb-076ff884249d tempest-ServerExternalEventsTest-1232251863 tempest-ServerExternalEventsTest-1232251863-project-member] Enqueued Resource ID: 34d3f208-bbb4-4415-9934-a2683e967524 with Priority: HIGHEST for action security_group_members [ 653.431957] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d3f208-bbb4-4415-9934-a2683e967524 with Priority: HIGHEST for action security_group_members [ 653.431957] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d3f208-bbb4-4415-9934-a2683e967524 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.431957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.431957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.431957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.431957] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.431957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.431957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.431957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.431957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.431957] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34d3f208-bbb4-4415-9934-a2683e967524',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.436138] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.436239] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.436301] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.436533] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.436754] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.436975] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-73db8238-f7e8-406c-86e5-f7bf7663e1ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.564941] env[69777]: INFO networking_nsxv3.common.synchronization [None req-6957aa56-d006-4923-b8fa-072237494d29 None None] Enqueued Resource ID: 8bf5531d-c5af-41dd-a118-46d7bac33cc3 with Priority: HIGHEST for action port [ 653.565259] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5531d-c5af-41dd-a118-46d7bac33cc3 with Priority: HIGHEST for action port [ 653.565897] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bf5531d-c5af-41dd-a118-46d7bac33cc3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.566079] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bf5531d-c5af-41dd-a118-46d7bac33cc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.566149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bf5531d-c5af-41dd-a118-46d7bac33cc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.566447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bf5531d-c5af-41dd-a118-46d7bac33cc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.566548] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bf5531d-c5af-41dd-a118-46d7bac33cc3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.731773] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.732050] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.732205] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.732466] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.732868] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.732868] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.733036] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.735160] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.735322] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.735534] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.735655] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.735769] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.735881] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.736033] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.736158] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.736361] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.755575] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.757031] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 653.757031] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.757031] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.757031] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.757031] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.757031] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.757819] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.759032] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.932976] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.933102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.933102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.933819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.933819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.933819] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.933819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.933819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.934041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.934041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.934041] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d3f208-bbb4-4415-9934-a2683e967524 already deleted. [ 653.934147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.068770] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bf5531d-c5af-41dd-a118-46d7bac33cc3 [ 654.069032] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.069914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.069914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.069914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.069914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.069914] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bf5531d-c5af-41dd-a118-46d7bac33cc3 already deleted. [ 654.069914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bf5531d-c5af-41dd-a118-46d7bac33cc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.263234] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.263234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.263234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.263234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.263234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.263234] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc not found, creating... [ 654.263234] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.263234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.263234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.263234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.263234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.263743] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.263743] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.263743] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.263984] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.263984] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.267704] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc is going to be created. [ 654.289337] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.289526] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.289654] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.289913] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.290142] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.290359] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.422329] env[69777]: INFO networking_nsxv3.common.synchronization [None req-1071bad5-a367-499f-9084-0423f34065c9 None None] Enqueued Resource ID: 653ca897-84e9-4737-bbcf-478f2c9eeb32 with Priority: HIGHEST for action port [ 654.423287] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653ca897-84e9-4737-bbcf-478f2c9eeb32 with Priority: HIGHEST for action port [ 654.424100] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-653ca897-84e9-4737-bbcf-478f2c9eeb32 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.424232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-653ca897-84e9-4737-bbcf-478f2c9eeb32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.424372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-653ca897-84e9-4737-bbcf-478f2c9eeb32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.424544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-653ca897-84e9-4737-bbcf-478f2c9eeb32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.424678] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('653ca897-84e9-4737-bbcf-478f2c9eeb32',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.461606] env[69777]: INFO networking_nsxv3.common.synchronization [req-e006f71a-0c5c-45c5-81e3-3a66bb007e54 req-164c9b53-087b-4146-9b63-9d091f6511bb service nova] Enqueued Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_rules [ 654.463153] env[69777]: INFO networking_nsxv3.common.synchronization [req-e006f71a-0c5c-45c5-81e3-3a66bb007e54 req-164c9b53-087b-4146-9b63-9d091f6511bb service nova] Enqueued Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 654.463153] env[69777]: INFO networking_nsxv3.common.synchronization [req-e006f71a-0c5c-45c5-81e3-3a66bb007e54 req-164c9b53-087b-4146-9b63-9d091f6511bb service nova] Enqueued Resource ID: 73db8238-f7e8-406c-86e5-f7bf7663e1ec with Priority: HIGHEST for action port [ 654.463153] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_rules [ 654.463153] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 654.463153] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73db8238-f7e8-406c-86e5-f7bf7663e1ec with Priority: HIGHEST for action port [ 654.464199] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.465815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.465928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.466275] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.466397] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.467319] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.467407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.467472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.467665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.467846] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.467968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.468687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.468687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.468687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.468687] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.469857] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-73db8238-f7e8-406c-86e5-f7bf7663e1ec taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.471689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73db8238-f7e8-406c-86e5-f7bf7663e1ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.471689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73db8238-f7e8-406c-86e5-f7bf7663e1ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.471689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73db8238-f7e8-406c-86e5-f7bf7663e1ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.471689] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73db8238-f7e8-406c-86e5-f7bf7663e1ec',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.930438] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 653ca897-84e9-4737-bbcf-478f2c9eeb32 [ 654.930709] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.930833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.930906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.931134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.931218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.931312] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:653ca897-84e9-4737-bbcf-478f2c9eeb32 already deleted. [ 654.931389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-653ca897-84e9-4737-bbcf-478f2c9eeb32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.973489] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.974037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.987095] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73db8238-f7e8-406c-86e5-f7bf7663e1ec with status ACTIVE [ 654.987354] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.987482] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.987936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.987936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.987936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.988084] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.988187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.988247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.988397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.988470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.988656] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.988746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.988906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.988968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.989012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.989520] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73db8238-f7e8-406c-86e5-f7bf7663e1ec is going to be updated. [ 654.992172] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.015595] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.015595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.015595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.015595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.015595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.015595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73db8238-f7e8-406c-86e5-f7bf7663e1ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.275453] env[69777]: INFO networking_nsxv3.common.synchronization [req-b540d93c-d9b6-44bf-a68e-fa0191f5a4d8 req-09050673-7921-48bd-b69b-24c95bd5fc6b service nova] Enqueued Resource ID: 34d3f208-bbb4-4415-9934-a2683e967524 with Priority: HIGHEST for action security_group_rules [ 655.276793] env[69777]: INFO networking_nsxv3.common.synchronization [req-b540d93c-d9b6-44bf-a68e-fa0191f5a4d8 req-09050673-7921-48bd-b69b-24c95bd5fc6b service nova] Enqueued Resource ID: 34d3f208-bbb4-4415-9934-a2683e967524 with Priority: HIGHEST for action security_group_members [ 655.276793] env[69777]: INFO networking_nsxv3.common.synchronization [req-b540d93c-d9b6-44bf-a68e-fa0191f5a4d8 req-09050673-7921-48bd-b69b-24c95bd5fc6b service nova] Enqueued Resource ID: 7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc with Priority: HIGHEST for action port [ 655.280312] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d3f208-bbb4-4415-9934-a2683e967524 with Priority: HIGHEST for action security_group_rules [ 655.280312] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d3f208-bbb4-4415-9934-a2683e967524 with Priority: HIGHEST for action security_group_members [ 655.280312] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc with Priority: HIGHEST for action port [ 655.280312] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34d3f208-bbb4-4415-9934-a2683e967524 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.280312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.280312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.280312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.280312] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34d3f208-bbb4-4415-9934-a2683e967524',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.280312] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d3f208-bbb4-4415-9934-a2683e967524 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.280312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.280312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.280312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.280312] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.280312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.280312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.280312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.280312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.281048] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34d3f208-bbb4-4415-9934-a2683e967524',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.282114] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.282410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.282566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.282795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.282955] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.448873] env[69777]: INFO networking_nsxv3.common.synchronization [None req-308eae2a-2be0-4079-a247-67f9869e03e9 None None] Enqueued Resource ID: a7268717-6404-4f93-a645-852fdd6cf2fc with Priority: HIGHEST for action port [ 655.449148] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7268717-6404-4f93-a645-852fdd6cf2fc with Priority: HIGHEST for action port [ 655.449700] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7268717-6404-4f93-a645-852fdd6cf2fc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.449827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7268717-6404-4f93-a645-852fdd6cf2fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.450044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7268717-6404-4f93-a645-852fdd6cf2fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.451137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7268717-6404-4f93-a645-852fdd6cf2fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.451137] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7268717-6404-4f93-a645-852fdd6cf2fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.495170] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.555385] env[69777]: INFO networking_nsxv3.common.synchronization [None req-9495b4b5-3694-4649-8231-6496bbd102ae None None] Enqueued Resource ID: ed1ef730-4184-44eb-9d0c-42856c87f350 with Priority: HIGHEST for action port [ 655.555385] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed1ef730-4184-44eb-9d0c-42856c87f350 with Priority: HIGHEST for action port [ 655.555580] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed1ef730-4184-44eb-9d0c-42856c87f350 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.555693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed1ef730-4184-44eb-9d0c-42856c87f350" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.555762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed1ef730-4184-44eb-9d0c-42856c87f350" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.556054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed1ef730-4184-44eb-9d0c-42856c87f350" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.556149] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed1ef730-4184-44eb-9d0c-42856c87f350',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.789845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d3f208-bbb4-4415-9934-a2683e967524 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.789845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.789845] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34d3f208-bbb4-4415-9934-a2683e967524',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.789845] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc with status ACTIVE [ 655.789845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.789845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.789845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.789845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.789845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.789845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.789845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.789845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.789845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.790486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.794422] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.794422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.794422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.794813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.794813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.794813] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc is going to be updated. [ 655.817962] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.818087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.818138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.818355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.818501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.818658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ec6e8a9-adf3-48ee-8aa9-e0b12b843ddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.953376] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7268717-6404-4f93-a645-852fdd6cf2fc [ 655.953693] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.953950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.954019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.954312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.954467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.954595] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7268717-6404-4f93-a645-852fdd6cf2fc already deleted. [ 655.954717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7268717-6404-4f93-a645-852fdd6cf2fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.999583] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.999583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.999583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.999907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.000396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.000396] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 is going to be created. [ 656.013473] env[69777]: INFO networking_nsxv3.common.synchronization [req-26b4efd7-05ef-478f-abb0-95425cc24524 req-ad37b6ae-7eba-4ba7-b307-8f5d04851990 tempest-AttachInterfacesV270Test-1559009987 tempest-AttachInterfacesV270Test-1559009987-project-member] Enqueued Resource ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a with Priority: HIGHEST for action security_group_members [ 656.016751] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a with Priority: HIGHEST for action security_group_members [ 656.016751] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd70cffe-95a5-47b4-9c07-a7316a03b88a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.016751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.016751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.016751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.016751] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.016751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.016751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.016751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.016751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.016751] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd70cffe-95a5-47b4-9c07-a7316a03b88a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.025265] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.025685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.025854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.026154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.026369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.037771] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: UNINITIALIZED for 2s [ 656.062776] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed1ef730-4184-44eb-9d0c-42856c87f350 [ 656.062776] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.062935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.063023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.063280] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.063433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.063672] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed1ef730-4184-44eb-9d0c-42856c87f350 already deleted. [ 656.063825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed1ef730-4184-44eb-9d0c-42856c87f350" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.132240] env[69777]: INFO networking_nsxv3.common.synchronization [None req-53a86819-852c-4c73-87c5-c0d5ae560770 tempest-VolumesAssistedSnapshotsTest-134890089 tempest-VolumesAssistedSnapshotsTest-134890089-project-member] Enqueued Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_rules [ 656.132875] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_rules [ 656.134465] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.134607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.134676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.134959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.135084] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c1512ec-3cb3-4a3e-9626-035d7eea4067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.298342] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34d3f208-bbb4-4415-9934-a2683e967524',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.432023] env[69777]: INFO networking_nsxv3.common.synchronization [None req-d47f8ae7-0ca0-4767-9f72-d12ee4f92ead tempest-VolumesAssistedSnapshotsTest-134890089 tempest-VolumesAssistedSnapshotsTest-134890089-project-member] Enqueued Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_rules [ 656.432023] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_rules [ 656.432023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.435112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.521490] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.521661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.521706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.521922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.522017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.522212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.522305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.522362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.522518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.522592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.522671] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a already deleted. [ 656.522744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.654609] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.655559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.655559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.655559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.655559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.655559] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 already deleted. [ 656.655559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.655559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.655559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.655984] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c1512ec-3cb3-4a3e-9626-035d7eea4067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.805470] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.805776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.805776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.806652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.806652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.806652] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d3f208-bbb4-4415-9934-a2683e967524 is going to be created. [ 656.836126] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.836288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.836357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.836565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.836732] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.846904] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d3f208-bbb4-4415-9934-a2683e967524 in Status: UNINITIALIZED for 2s [ 657.093543] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.093859] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-434" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.093859] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-434" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.094216] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-434" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.094479] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.094793] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.094793] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.094962] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.095414] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.095568] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.095687] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.095799] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.095910] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.096069] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.096277] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.096327] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.113368] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.113594] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 657.113769] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.113999] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-434" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.114337] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-7dacc13a-966a-4a08-97a6-f896ff40ad7e taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.114507] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-7dacc13a-966a-4a08-97a6-f896ff40ad7e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.114664] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-7dacc13a-966a-4a08-97a6-f896ff40ad7e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.114931] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-7dacc13a-966a-4a08-97a6-f896ff40ad7e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.115078] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dacc13a-966a-4a08-97a6-f896ff40ad7e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.181570] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.181570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.181745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.181835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.181939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.182017] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 already deleted. [ 657.182111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.469266] env[69777]: INFO networking_nsxv3.common.synchronization [None req-65c0ca49-d34e-4b0b-b227-54647152625d None None] Enqueued Resource ID: f6e602bd-ff0e-420c-b301-4d3dfe5e52ec with Priority: HIGHEST for action port [ 657.469506] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6e602bd-ff0e-420c-b301-4d3dfe5e52ec with Priority: HIGHEST for action port [ 657.471247] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6e602bd-ff0e-420c-b301-4d3dfe5e52ec taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.471418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6e602bd-ff0e-420c-b301-4d3dfe5e52ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.471836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6e602bd-ff0e-420c-b301-4d3dfe5e52ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.472104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6e602bd-ff0e-420c-b301-4d3dfe5e52ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.472194] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6e602bd-ff0e-420c-b301-4d3dfe5e52ec',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.620408] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.620408] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.620408] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.620408] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.620408] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.620408] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 7dacc13a-966a-4a08-97a6-f896ff40ad7e not found, creating... [ 657.620408] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.620408] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.620408] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.620408] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.620408] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.620829] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.620829] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.622156] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.622822] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.623105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.624062] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 7dacc13a-966a-4a08-97a6-f896ff40ad7e is going to be created. [ 657.647468] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.647468] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.647468] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.647468] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.647468] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.647468] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-7dacc13a-966a-4a08-97a6-f896ff40ad7e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.974864] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6e602bd-ff0e-420c-b301-4d3dfe5e52ec [ 657.975020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.975179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.980035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.980035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.980035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.980035] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6e602bd-ff0e-420c-b301-4d3dfe5e52ec already deleted. [ 657.980035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6e602bd-ff0e-420c-b301-4d3dfe5e52ec" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.048853] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: SUCCESS [ 658.048981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.049196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.049403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.049624] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.049690] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.050736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.050736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.050736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.050736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.050736] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.089305] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c00f8af-6611-4202-96a6-6009c676bdde req-57a98e25-2a42-429a-b365-fa9d5d6cd6b1 tempest-MigrationsAdminTest-640993244 tempest-MigrationsAdminTest-640993244-project-member] Enqueued Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 658.089823] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 658.090112] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.090231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.090276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.090499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.090677] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.090741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.090801] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.091051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.091151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.091247] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.552541] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.552775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.552775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.553023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.553332] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.553468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.553468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.553555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.553638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.554556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.554733] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.556274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.556357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.556502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.556651] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.556745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.556805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.556998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.557132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.557224] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.558269] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.597356] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.599541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.599646] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.601047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.601047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.601047] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.601047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.601047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.601047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.601047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.601047] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e already deleted. [ 658.601047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.803012] env[69777]: INFO networking_nsxv3.common.synchronization [None req-03f8578d-9573-47ce-b64c-675ad7efeaa8 None None] Enqueued Resource ID: bdedf41e-bfdf-4034-8650-34057c6c511d with Priority: HIGHEST for action port [ 658.803465] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdedf41e-bfdf-4034-8650-34057c6c511d with Priority: HIGHEST for action port [ 658.805257] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdedf41e-bfdf-4034-8650-34057c6c511d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.805542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdedf41e-bfdf-4034-8650-34057c6c511d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.805695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdedf41e-bfdf-4034-8650-34057c6c511d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.806206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdedf41e-bfdf-4034-8650-34057c6c511d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.806482] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdedf41e-bfdf-4034-8650-34057c6c511d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.855770] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d3f208-bbb4-4415-9934-a2683e967524 in Status: SUCCESS [ 658.856632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.856789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.857066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.857507] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.857507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.857507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.857667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.857753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.857885] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.858083] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34d3f208-bbb4-4415-9934-a2683e967524',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.025396] env[69777]: INFO networking_nsxv3.common.synchronization [None req-16429d6d-d662-4717-a774-4495565d4b7b None None] Enqueued Resource ID: a8ed5cd8-f45c-4333-9a4f-dd2b7ae3e3e7 with Priority: HIGHEST for action port [ 659.025396] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8ed5cd8-f45c-4333-9a4f-dd2b7ae3e3e7 with Priority: HIGHEST for action port [ 659.025396] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8ed5cd8-f45c-4333-9a4f-dd2b7ae3e3e7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.025396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8ed5cd8-f45c-4333-9a4f-dd2b7ae3e3e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.025396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8ed5cd8-f45c-4333-9a4f-dd2b7ae3e3e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.025396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8ed5cd8-f45c-4333-9a4f-dd2b7ae3e3e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.025396] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8ed5cd8-f45c-4333-9a4f-dd2b7ae3e3e7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.060093] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eabc2a2-99dc-4c4c-844b-193f2dc6c288: rpc.has_security_group_logging(os_id): False [ 659.061929] env[69777]: INFO networking_nsxv3.common.synchronization [req-26b4efd7-05ef-478f-abb0-95425cc24524 req-c36619f5-de57-487f-955c-d862aed694ab service nova] Enqueued Resource ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a with Priority: HIGHEST for action security_group_rules [ 659.063302] env[69777]: INFO networking_nsxv3.common.synchronization [req-26b4efd7-05ef-478f-abb0-95425cc24524 req-c36619f5-de57-487f-955c-d862aed694ab service nova] Enqueued Resource ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a with Priority: HIGHEST for action security_group_members [ 659.063302] env[69777]: INFO networking_nsxv3.common.synchronization [req-26b4efd7-05ef-478f-abb0-95425cc24524 req-c36619f5-de57-487f-955c-d862aed694ab service nova] Enqueued Resource ID: 7dacc13a-966a-4a08-97a6-f896ff40ad7e with Priority: HIGHEST for action port [ 659.063713] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a with Priority: HIGHEST for action security_group_rules [ 659.063934] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a with Priority: HIGHEST for action security_group_members [ 659.063934] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dacc13a-966a-4a08-97a6-f896ff40ad7e with Priority: HIGHEST for action port [ 659.065069] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd70cffe-95a5-47b4-9c07-a7316a03b88a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.065645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.065807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.066393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.066393] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd70cffe-95a5-47b4-9c07-a7316a03b88a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.068444] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd70cffe-95a5-47b4-9c07-a7316a03b88a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.068444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.068444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.068444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.068444] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.068444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.068444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.068444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.068444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.068444] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd70cffe-95a5-47b4-9c07-a7316a03b88a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.069288] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dacc13a-966a-4a08-97a6-f896ff40ad7e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.069409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dacc13a-966a-4a08-97a6-f896ff40ad7e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.069471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dacc13a-966a-4a08-97a6-f896ff40ad7e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.069634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dacc13a-966a-4a08-97a6-f896ff40ad7e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.069735] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dacc13a-966a-4a08-97a6-f896ff40ad7e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.074940] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.076016] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.076016] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.076390] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.077579] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.077916] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.077916] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.078224] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.078299] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.078497] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.078607] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.079861] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.079861] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.079861] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.079861] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.079861] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.081935] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.081935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.081935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.081935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.082159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.082419] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.082419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.082419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.083769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.083769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.083769] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.083769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.083769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.083769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.083769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.083769] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.083769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.083769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.083769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.083769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.083769] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 is going to be created. [ 659.114316] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.114316] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.114316] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.114316] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.114316] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-9a6c2151-9ef3-4f80-9df0-8dba9f4b2380 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.114316] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-9a6c2151-9ef3-4f80-9df0-8dba9f4b2380" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.114316] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-9a6c2151-9ef3-4f80-9df0-8dba9f4b2380" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.114635] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-9a6c2151-9ef3-4f80-9df0-8dba9f4b2380" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.114635] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a6c2151-9ef3-4f80-9df0-8dba9f4b2380',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.145330] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.145505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.145566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.145788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.146092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.156087] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: IN_PROGRESS for 2s [ 659.309213] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdedf41e-bfdf-4034-8650-34057c6c511d [ 659.309447] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.309582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.309656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.309863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.309972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.310056] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdedf41e-bfdf-4034-8650-34057c6c511d already deleted. [ 659.310169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdedf41e-bfdf-4034-8650-34057c6c511d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.361322] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d3f208-bbb4-4415-9934-a2683e967524 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.363027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.363027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.363027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.363027] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.363027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.363027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.363027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.363027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.363027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.363511] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d3f208-bbb4-4415-9934-a2683e967524 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.363511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.363511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.363511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.363511] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.363681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.363681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.363922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.363922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.364043] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.364077] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34d3f208-bbb4-4415-9934-a2683e967524',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.529735] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8ed5cd8-f45c-4333-9a4f-dd2b7ae3e3e7 [ 659.529735] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.529735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.529735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.529735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.529735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.529735] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8ed5cd8-f45c-4333-9a4f-dd2b7ae3e3e7 already deleted. [ 659.529735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8ed5cd8-f45c-4333-9a4f-dd2b7ae3e3e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.577045] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd70cffe-95a5-47b4-9c07-a7316a03b88a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.577045] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd70cffe-95a5-47b4-9c07-a7316a03b88a taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.577045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.586588] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7dacc13a-966a-4a08-97a6-f896ff40ad7e with status ACTIVE [ 659.586910] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.587311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.587677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.591072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.592042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.592042] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.592042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.592042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.592042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.592042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.592293] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.592293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.592293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.592393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.592469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.592519] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7dacc13a-966a-4a08-97a6-f896ff40ad7e is going to be updated. [ 659.619029] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.619029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.619029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.619029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.619029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.619029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dacc13a-966a-4a08-97a6-f896ff40ad7e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.619443] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.619443] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.619443] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.622386] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.622730] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.622730] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 9a6c2151-9ef3-4f80-9df0-8dba9f4b2380 not found, creating... [ 659.623211] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.623430] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.623557] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.623795] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.623938] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.624249] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.624410] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.624531] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.624744] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.624877] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.625029] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 9a6c2151-9ef3-4f80-9df0-8dba9f4b2380 is going to be created. [ 659.646302] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.646506] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.646625] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.647151] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.647192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.647425] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-9a6c2151-9ef3-4f80-9df0-8dba9f4b2380" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.868338] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34d3f208-bbb4-4415-9934-a2683e967524: rpc.has_security_group_logging(os_id): False [ 659.887415] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.887415] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.887415] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.887415] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.887621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.887764] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.887764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.888578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.888578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.888578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.888578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.888578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.888578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.888578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.888578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.888578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.888578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.889262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.890281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.890281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.890359] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34d3f208-bbb4-4415-9934-a2683e967524 is going to be created. [ 659.943820] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.944955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.944955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.944955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.944955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.956731] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34d3f208-bbb4-4415-9934-a2683e967524 in Status: IN_PROGRESS for 2s [ 660.079112] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd70cffe-95a5-47b4-9c07-a7316a03b88a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.400828] env[69777]: INFO networking_nsxv3.common.synchronization [None req-b670b24c-330a-4dec-88dd-c191afb79045 None None] Enqueued Resource ID: e1a4cfca-d447-410f-8c17-b4bc5dbf5d9d with Priority: HIGHEST for action port [ 660.400828] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1a4cfca-d447-410f-8c17-b4bc5dbf5d9d with Priority: HIGHEST for action port [ 660.400828] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1a4cfca-d447-410f-8c17-b4bc5dbf5d9d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.400828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1a4cfca-d447-410f-8c17-b4bc5dbf5d9d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.400828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1a4cfca-d447-410f-8c17-b4bc5dbf5d9d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.400828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1a4cfca-d447-410f-8c17-b4bc5dbf5d9d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.400828] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a4cfca-d447-410f-8c17-b4bc5dbf5d9d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.584092] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.584092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.584092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.584092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.584092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.584092] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a is going to be created. [ 660.607566] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.607720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.607789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.607995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.608194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.627580] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a in Status: UNINITIALIZED for 2s [ 660.760874] env[69777]: INFO networking_nsxv3.common.synchronization [req-99ecf7a9-5250-411e-aee0-230d8be5b924 req-c66af358-4e9f-43a5-9cf4-2f0f8eb1c6f3 tempest-ServersAdminTestJSON-1100102510 tempest-ServersAdminTestJSON-1100102510-project-member] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 660.762462] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 660.762587] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.762758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.762847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.763143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.763386] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.763464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.763523] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.763689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.763759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.763853] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.906455] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1a4cfca-d447-410f-8c17-b4bc5dbf5d9d [ 660.906455] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.906455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.906455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.906455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.906455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.906455] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1a4cfca-d447-410f-8c17-b4bc5dbf5d9d already deleted. [ 660.906455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1a4cfca-d447-410f-8c17-b4bc5dbf5d9d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.169478] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: SUCCESS [ 661.169744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.268178] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.268340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.268473] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.268668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.268766] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.268963] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.269099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.269167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.269318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.269395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.269481] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e already deleted. [ 661.269560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.420911] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c00f8af-6611-4202-96a6-6009c676bdde req-7bdfedff-a5e4-4a75-97d3-968f26a5146f service nova] Enqueued Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_rules [ 661.421109] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c00f8af-6611-4202-96a6-6009c676bdde req-7bdfedff-a5e4-4a75-97d3-968f26a5146f service nova] Enqueued Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 661.421252] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c00f8af-6611-4202-96a6-6009c676bdde req-7bdfedff-a5e4-4a75-97d3-968f26a5146f service nova] Enqueued Resource ID: 9a6c2151-9ef3-4f80-9df0-8dba9f4b2380 with Priority: HIGHEST for action port [ 661.422336] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_rules [ 661.422553] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 661.423355] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a6c2151-9ef3-4f80-9df0-8dba9f4b2380 with Priority: HIGHEST for action port [ 661.423912] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.424067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.424148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.424395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.424481] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.426055] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.426175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.426247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.426419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.426572] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.431335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.431335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.431335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.431335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.431335] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.431335] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a6c2151-9ef3-4f80-9df0-8dba9f4b2380 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.431335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a6c2151-9ef3-4f80-9df0-8dba9f4b2380" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.431335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a6c2151-9ef3-4f80-9df0-8dba9f4b2380" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.431335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a6c2151-9ef3-4f80-9df0-8dba9f4b2380" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.431335] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a6c2151-9ef3-4f80-9df0-8dba9f4b2380',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.659425] env[69777]: INFO networking_nsxv3.common.synchronization [None req-5482eb12-7cba-49fb-bbe2-73f83794f7b0 tempest-ServersWithSpecificFlavorTestJSON-1722080042 tempest-ServersWithSpecificFlavorTestJSON-1722080042-project-member] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_rules [ 661.660141] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_rules [ 661.660781] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.662029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.662191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.662492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.662789] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.842519] env[69777]: INFO networking_nsxv3.common.synchronization [None req-7edc2143-c772-46af-8a3f-1c23058241d9 tempest-ServersWithSpecificFlavorTestJSON-1722080042 tempest-ServersWithSpecificFlavorTestJSON-1722080042-project-member] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_rules [ 661.842519] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_rules [ 661.842519] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.842519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.884015] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.884787] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.884787] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.887320] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.887320] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.887320] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.887320] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.887320] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.887320] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.887320] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.887320] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.887320] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.887320] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.887320] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.887320] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.887952] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.908609] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.909587] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 661.909695] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.910453] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.910893] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.911125] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.911659] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.913392] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.913500] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.931112] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.935104] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.935104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.935104] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a6c2151-9ef3-4f80-9df0-8dba9f4b2380 with status ACTIVE [ 661.935104] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.935104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.935104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.935104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.935104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.935104] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.935104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.935104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.935104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.935104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.935104] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.935788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.935788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.935788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.935874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.936038] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a6c2151-9ef3-4f80-9df0-8dba9f4b2380 is going to be updated. [ 661.961637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.961637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.961637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.962050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.962357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.962826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a6c2151-9ef3-4f80-9df0-8dba9f4b2380" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.975844] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34d3f208-bbb4-4415-9934-a2683e967524 in Status: SUCCESS [ 661.975894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.184016] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.184016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.184176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.184939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.184939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.184939] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 already deleted. [ 662.184939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.184939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.184939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.184939] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.416788] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.420018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.420018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.420018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.420018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.420018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3 not found, creating... [ 662.420018] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.420018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.420018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.420018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.420018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.420454] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.420454] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.420454] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.420454] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.420454] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.420454] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3 is going to be created. [ 662.441399] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.441627] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.441800] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.442035] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.442270] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.442517] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.443727] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.640452] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a in Status: SUCCESS [ 662.641427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.641427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.644894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.644894] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.644894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.644894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.644894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.644894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.644894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.644894] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd70cffe-95a5-47b4-9c07-a7316a03b88a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.712989] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.712989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.712989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.712989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.712989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.712989] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 already deleted. [ 662.712989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.947302] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.947564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.947564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.950316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.950444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.950601] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e is going to be created. [ 662.975422] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.975422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.975422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.975672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.975672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.987386] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: UNINITIALIZED for 2s [ 663.150124] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd70cffe-95a5-47b4-9c07-a7316a03b88a taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.150124] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.150124] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd70cffe-95a5-47b4-9c07-a7316a03b88a taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.150124] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.150124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.150600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.150600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.150600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.150600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.150600] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd70cffe-95a5-47b4-9c07-a7316a03b88a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.228965] env[69777]: INFO networking_nsxv3.common.synchronization [req-6a43ceb8-8112-4e56-9dc7-91a5a1290cbe req-d84cf92a-c8a6-43d0-b38f-34b7e5e2f17c tempest-ServersAdminTestJSON-1100102510 tempest-ServersAdminTestJSON-1100102510-project-member] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 663.229393] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 663.229393] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.232330] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.232987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.232987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.232987] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.232987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.233232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.233232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.233306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.233355] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.657231] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd70cffe-95a5-47b4-9c07-a7316a03b88a: rpc.has_security_group_logging(os_id): False [ 663.676985] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.677167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.677167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.677625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.677625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.677762] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.677822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.677857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.679295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.679295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.679295] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.679295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.679295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.679295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.679295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.679295] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.679295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.679295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.680524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.681112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.681112] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a is going to be created. [ 663.727453] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a693edda-b42c-4f92-9c67-661def0fbe6c None None] Enqueued Resource ID: 57a0f554-7306-410b-aec9-0dd042128b98 with Priority: HIGHEST for action port [ 663.727720] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a0f554-7306-410b-aec9-0dd042128b98 with Priority: HIGHEST for action port [ 663.728339] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-57a0f554-7306-410b-aec9-0dd042128b98 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.728465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57a0f554-7306-410b-aec9-0dd042128b98" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.728526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57a0f554-7306-410b-aec9-0dd042128b98" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.728798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57a0f554-7306-410b-aec9-0dd042128b98" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.728885] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57a0f554-7306-410b-aec9-0dd042128b98',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.739465] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.739465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.739465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.739465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.739712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.740842] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.754061] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a in Status: IN_PROGRESS for 2s [ 664.234018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57a0f554-7306-410b-aec9-0dd042128b98 [ 664.234018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.234018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.234018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.234018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.234018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.234018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57a0f554-7306-410b-aec9-0dd042128b98 already deleted. [ 664.234018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57a0f554-7306-410b-aec9-0dd042128b98" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.244841] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.379126] env[69777]: INFO networking_nsxv3.common.synchronization [req-99ecf7a9-5250-411e-aee0-230d8be5b924 req-da13d94b-ec43-475b-8149-c4cc85eb4ea2 service nova] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_rules [ 664.379126] env[69777]: INFO networking_nsxv3.common.synchronization [req-99ecf7a9-5250-411e-aee0-230d8be5b924 req-da13d94b-ec43-475b-8149-c4cc85eb4ea2 service nova] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 664.379126] env[69777]: INFO networking_nsxv3.common.synchronization [req-99ecf7a9-5250-411e-aee0-230d8be5b924 req-da13d94b-ec43-475b-8149-c4cc85eb4ea2 service nova] Enqueued Resource ID: d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3 with Priority: HIGHEST for action port [ 664.379126] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_rules [ 664.379126] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 664.379126] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3 with Priority: HIGHEST for action port [ 664.380556] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.380556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.383741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.383741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.383741] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.383741] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.383741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.383741] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.383741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.383741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.383741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.383741] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.749742] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.750015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.750738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.751339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.751471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.751579] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be created. [ 664.787113] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.787243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.787365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.789238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.789238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.799796] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: UNINITIALIZED for 2s [ 664.848653] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.849727] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.849727] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.849727] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.849727] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.849897] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.854249] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.854249] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.854249] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.854249] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.854249] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.854249] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.854249] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.854249] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.854249] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.855766] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.872718] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.873421] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 664.873421] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.873548] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.874184] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-7c05abaf-77b6-4383-a608-91e49cc6b9cd taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.874840] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-7c05abaf-77b6-4383-a608-91e49cc6b9cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.874840] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-7c05abaf-77b6-4383-a608-91e49cc6b9cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.875012] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-7c05abaf-77b6-4383-a608-91e49cc6b9cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.875631] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c05abaf-77b6-4383-a608-91e49cc6b9cd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.884568] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.884568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.884568] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3 with status ACTIVE [ 664.885315] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.885315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.885315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.885315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.885315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.885541] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.885541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.885631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.885796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.886436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.886436] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.886436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.886436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.886436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.886798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.886798] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3 is going to be updated. [ 664.910070] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.910226] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.910295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.910591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.910855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.910952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d53c47f1-d7bd-47d7-bf4b-cfc7cd03d8f3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.999496] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: SUCCESS [ 664.999721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.999917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.000159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.000354] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.001101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.001101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.001101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.001101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.001101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.001101] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.313808] env[69777]: INFO networking_nsxv3.common.synchronization [req-4f947a41-02dc-4410-8d04-19f4aa13c465 req-5e34ce60-cd36-4c81-bedd-379f1f83c84b tempest-ListServerFiltersTestJSON-475682025 tempest-ListServerFiltersTestJSON-475682025-project-member] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 665.313808] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 665.313808] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.313808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.313808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.315782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.315782] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.315926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.316036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.316269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.316394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.316678] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.378938] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.379250] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.379384] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.379659] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.379809] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.380224] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 7c05abaf-77b6-4383-a608-91e49cc6b9cd not found, creating... [ 665.380224] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.380393] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.380700] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.380935] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.381099] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.381404] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.381558] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.381675] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.382177] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.382177] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.382177] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 7c05abaf-77b6-4383-a608-91e49cc6b9cd is going to be created. [ 665.404018] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.404244] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.404366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.404663] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.404893] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.405137] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-7c05abaf-77b6-4383-a608-91e49cc6b9cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.504617] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.504617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.504617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.504617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.504617] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.504617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.504617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.504905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.504905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.505229] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.505229] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.505229] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.505364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.505547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.505614] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.505672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.505752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.505898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.505975] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.506086] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.506181] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.788468] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a in Status: SUCCESS [ 665.788468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.819295] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.819544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.819768] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.819817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.819929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.820708] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.820982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.820982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.821215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.821272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.821352] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 already deleted. [ 665.821432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.899598] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-466 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.899598] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.899912] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.900423] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.901032] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.901789] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.902068] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.902931] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.903146] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.903888] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.904111] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.904245] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.904362] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.904482] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.904643] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.904736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.925813] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.925813] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 665.925813] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.925813] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.926263] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-ce83a64d-7221-459b-bce3-6c375e3bf6f7 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.929059] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-ce83a64d-7221-459b-bce3-6c375e3bf6f7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.929059] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-ce83a64d-7221-459b-bce3-6c375e3bf6f7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.929059] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-ce83a64d-7221-459b-bce3-6c375e3bf6f7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.929059] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce83a64d-7221-459b-bce3-6c375e3bf6f7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.009174] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc849ff0-58d8-4b9a-9f49-53853fea6a2e: rpc.has_security_group_logging(os_id): False [ 666.029610] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.029694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.029694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.030277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.030277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.030408] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.030408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.030500] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.030704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.030704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.030880] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.030997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.031120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.031292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.031371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.031591] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.031703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.031756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.031903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.031993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.032670] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e is going to be created. [ 666.087714] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.088268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.088663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.089011] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.089691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.106192] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: IN_PROGRESS for 2s [ 666.430097] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.430387] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.430536] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.430745] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.430889] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.431084] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port ce83a64d-7221-459b-bce3-6c375e3bf6f7 not found, creating... [ 666.432360] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.433422] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.433422] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.433531] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.433600] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.433936] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.434162] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.434222] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.434504] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.436220] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.436220] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: ce83a64d-7221-459b-bce3-6c375e3bf6f7 is going to be created. [ 666.460477] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.460714] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.460982] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.461368] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.461467] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.462457] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-ce83a64d-7221-459b-bce3-6c375e3bf6f7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.507032] env[69777]: INFO networking_nsxv3.common.synchronization [req-6a43ceb8-8112-4e56-9dc7-91a5a1290cbe req-4995d3f2-b05c-4de3-b1fd-eb57d43e1592 service nova] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_rules [ 666.507227] env[69777]: INFO networking_nsxv3.common.synchronization [req-6a43ceb8-8112-4e56-9dc7-91a5a1290cbe req-4995d3f2-b05c-4de3-b1fd-eb57d43e1592 service nova] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 666.507371] env[69777]: INFO networking_nsxv3.common.synchronization [req-6a43ceb8-8112-4e56-9dc7-91a5a1290cbe req-4995d3f2-b05c-4de3-b1fd-eb57d43e1592 service nova] Enqueued Resource ID: 7c05abaf-77b6-4383-a608-91e49cc6b9cd with Priority: HIGHEST for action port [ 666.507606] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_rules [ 666.507737] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 666.507829] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c05abaf-77b6-4383-a608-91e49cc6b9cd with Priority: HIGHEST for action port [ 666.508438] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.508559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.508847] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.508847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.508998] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c05abaf-77b6-4383-a608-91e49cc6b9cd taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.509181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c05abaf-77b6-4383-a608-91e49cc6b9cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.509181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c05abaf-77b6-4383-a608-91e49cc6b9cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.509434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c05abaf-77b6-4383-a608-91e49cc6b9cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.509434] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c05abaf-77b6-4383-a608-91e49cc6b9cd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.810675] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 666.810937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.810985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.811214] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.811396] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.811515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.811579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.811723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.811802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.811894] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.013283] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c05abaf-77b6-4383-a608-91e49cc6b9cd with status ACTIVE [ 667.013518] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.013648] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.013717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.013935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.014121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.014617] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.014617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.014617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.017895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.017895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.017895] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.017895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.017895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.017895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.017895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.017895] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c05abaf-77b6-4383-a608-91e49cc6b9cd is going to be updated. [ 667.041211] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.042131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.042131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.042131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.042131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.042131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c05abaf-77b6-4383-a608-91e49cc6b9cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.314026] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.415742] env[69777]: INFO networking_nsxv3.common.synchronization [None req-1dffb044-77a1-4cda-9302-5893a7a9fe18 None None] Enqueued Resource ID: 669e50d9-b082-4c41-ae82-81ea56ef2002 with Priority: HIGHEST for action port [ 667.416324] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 669e50d9-b082-4c41-ae82-81ea56ef2002 with Priority: HIGHEST for action port [ 667.416627] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-669e50d9-b082-4c41-ae82-81ea56ef2002 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.416752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-669e50d9-b082-4c41-ae82-81ea56ef2002" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.416819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-669e50d9-b082-4c41-ae82-81ea56ef2002" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.423040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-669e50d9-b082-4c41-ae82-81ea56ef2002" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.423040] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('669e50d9-b082-4c41-ae82-81ea56ef2002',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.718364] env[69777]: INFO networking_nsxv3.common.synchronization [req-4f947a41-02dc-4410-8d04-19f4aa13c465 req-9045d1b8-2c6a-4a05-be2f-27bd1ad8a1f2 service nova] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_rules [ 667.718364] env[69777]: INFO networking_nsxv3.common.synchronization [req-4f947a41-02dc-4410-8d04-19f4aa13c465 req-9045d1b8-2c6a-4a05-be2f-27bd1ad8a1f2 service nova] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 667.718364] env[69777]: INFO networking_nsxv3.common.synchronization [req-4f947a41-02dc-4410-8d04-19f4aa13c465 req-9045d1b8-2c6a-4a05-be2f-27bd1ad8a1f2 service nova] Enqueued Resource ID: ce83a64d-7221-459b-bce3-6c375e3bf6f7 with Priority: HIGHEST for action port [ 667.718364] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_rules [ 667.718364] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 667.718364] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce83a64d-7221-459b-bce3-6c375e3bf6f7 with Priority: HIGHEST for action port [ 667.718364] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.718364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.718364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.719782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.719870] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.720728] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.720846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.720979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.724673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.724673] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.724673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.724673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.724673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.724673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.724673] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.724673] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce83a64d-7221-459b-bce3-6c375e3bf6f7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.724673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce83a64d-7221-459b-bce3-6c375e3bf6f7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.724673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce83a64d-7221-459b-bce3-6c375e3bf6f7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.725628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce83a64d-7221-459b-bce3-6c375e3bf6f7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.727538] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce83a64d-7221-459b-bce3-6c375e3bf6f7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.817416] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.924484] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 669e50d9-b082-4c41-ae82-81ea56ef2002 [ 667.924807] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.924921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.924973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.925249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.925334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.925466] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:669e50d9-b082-4c41-ae82-81ea56ef2002 already deleted. [ 667.925578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-669e50d9-b082-4c41-ae82-81ea56ef2002" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.116286] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: SUCCESS [ 668.117084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.228825] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.228825] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.228825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.228825] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce83a64d-7221-459b-bce3-6c375e3bf6f7 with status ACTIVE [ 668.228825] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.228825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.228825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.229227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.229227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.229376] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.229453] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.229490] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.229633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.229708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.229883] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.229973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.232708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.233105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.233257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.233425] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce83a64d-7221-459b-bce3-6c375e3bf6f7 is going to be updated. [ 668.246178] env[69777]: INFO networking_nsxv3.common.synchronization [req-4ad19969-d4c5-47dd-9a6f-b94b74719f9b req-bbcfb43c-aa8d-48b8-9245-138a242fd248 tempest-ListServerFiltersTestJSON-475682025 tempest-ListServerFiltersTestJSON-475682025-project-member] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 668.248033] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 668.248033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.248033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.254320] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.254320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.254493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.254689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.254888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.255135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce83a64d-7221-459b-bce3-6c375e3bf6f7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.322774] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.323273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.323273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.324515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.324515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.324515] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 668.351296] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.351686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.351686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.352113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.354324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.361982] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 668.735926] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.238427] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.238787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.238787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.238941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.239024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.239131] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be created. [ 669.262384] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.262384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.262384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.262384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.262384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.270717] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: UNINITIALIZED for 2s [ 670.188776] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-466 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.189114] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.189314] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.189727] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.190134] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.190372] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.190548] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.190890] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.195287] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.195615] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.196074] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.196074] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.196467] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.196467] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.196467] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.196630] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.218823] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.218992] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 670.219166] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.219413] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.219947] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-3aa8e09e-0b75-4465-ab80-06de46ffc667 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.221724] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-3aa8e09e-0b75-4465-ab80-06de46ffc667" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.221724] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-3aa8e09e-0b75-4465-ab80-06de46ffc667" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.222753] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-3aa8e09e-0b75-4465-ab80-06de46ffc667" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.222753] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aa8e09e-0b75-4465-ab80-06de46ffc667',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.373221] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 670.373221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.373221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.378737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.378737] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.378737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.378737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.378737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.378737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.379068] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.379068] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.383232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.383232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.383232] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.383232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.383232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.383232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.383232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.383232] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.725398] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.725747] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.725805] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.726198] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.726428] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.726595] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 3aa8e09e-0b75-4465-ab80-06de46ffc667 not found, creating... [ 670.726876] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.727053] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.727242] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.727685] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.727892] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.728528] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.731809] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.731809] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.731809] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.731809] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.731809] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 3aa8e09e-0b75-4465-ab80-06de46ffc667 is going to be created. [ 670.751418] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.751733] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.751945] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.752102] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.752330] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.752667] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-3aa8e09e-0b75-4465-ab80-06de46ffc667" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.890023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.890023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.890023] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.891626] env[69777]: INFO networking_nsxv3.common.synchronization [req-b9f158d3-bffa-4de2-b27a-e227fef4b8be req-c5e5c328-6f3b-4874-b505-8be5710c1778 tempest-ListServerFiltersTestJSON-475682025 tempest-ListServerFiltersTestJSON-475682025-project-member] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 670.892330] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 670.893092] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.893092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.285705] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 671.286407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.286590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.286796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.286976] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.287104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.287177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.287335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.287411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.287490] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.287583] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.290353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.291343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.291343] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.291343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.291343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.291343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.291343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.291343] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.392634] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.795181] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.795181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.795181] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.898564] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.898753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.898833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.899062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.899167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.899270] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 671.926799] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.927368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.927368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.927507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.927594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.936799] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 672.175010] env[69777]: INFO networking_nsxv3.common.synchronization [None req-dda00bbd-b23d-4296-81fc-6e97a296450f None None] Enqueued Resource ID: c5b8eb88-4d9f-4a22-ab83-c8eaeb99f30c with Priority: HIGHEST for action port [ 672.175794] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b8eb88-4d9f-4a22-ab83-c8eaeb99f30c with Priority: HIGHEST for action port [ 672.176306] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5b8eb88-4d9f-4a22-ab83-c8eaeb99f30c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.176434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5b8eb88-4d9f-4a22-ab83-c8eaeb99f30c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.176501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5b8eb88-4d9f-4a22-ab83-c8eaeb99f30c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.176746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5b8eb88-4d9f-4a22-ab83-c8eaeb99f30c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.176833] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5b8eb88-4d9f-4a22-ab83-c8eaeb99f30c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.297322] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.303208] env[69777]: INFO networking_nsxv3.common.synchronization [req-6ecb0bde-722c-4fd7-b9d4-d1da9bfb4ae3 req-acaf2532-7b44-4223-8aa3-94538070e3a8 tempest-DeleteServersAdminTestJSON-1345289931 tempest-DeleteServersAdminTestJSON-1345289931-project-admin] Enqueued Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 672.303208] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 672.303208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.303208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.303208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.303208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.303208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.303208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.303208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.303208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.303208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.303208] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.587766] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-466 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.588075] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.588801] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.588801] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.589107] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.589324] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.589450] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.589671] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.589809] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.590876] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 672.590876] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.590876] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.590876] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.590876] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 672.590876] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.590876] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.595231] env[69777]: INFO networking_nsxv3.common.synchronization [None req-cb83b8fa-9e25-405c-bbe9-6a5715e45c69 None None] Enqueued Resource ID: 5ae13a8f-189d-4636-93d9-db49dd6a7ded with Priority: HIGHEST for action port [ 672.595456] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae13a8f-189d-4636-93d9-db49dd6a7ded with Priority: HIGHEST for action port [ 672.595969] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ae13a8f-189d-4636-93d9-db49dd6a7ded taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.596095] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ae13a8f-189d-4636-93d9-db49dd6a7ded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.596523] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ae13a8f-189d-4636-93d9-db49dd6a7ded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.596523] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ae13a8f-189d-4636-93d9-db49dd6a7ded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.597169] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ae13a8f-189d-4636-93d9-db49dd6a7ded',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.609175] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.609919] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 672.611728] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.611728] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-466" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.611728] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-60625715-cfae-46d3-bb1e-ec53ce638f44 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.611728] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-60625715-cfae-46d3-bb1e-ec53ce638f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.611728] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-60625715-cfae-46d3-bb1e-ec53ce638f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.611728] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-60625715-cfae-46d3-bb1e-ec53ce638f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.611728] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60625715-cfae-46d3-bb1e-ec53ce638f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.681593] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5b8eb88-4d9f-4a22-ab83-c8eaeb99f30c [ 672.681593] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.681593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.681593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.681593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.681593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.681815] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5b8eb88-4d9f-4a22-ab83-c8eaeb99f30c already deleted. [ 672.681815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5b8eb88-4d9f-4a22-ab83-c8eaeb99f30c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.741247] env[69777]: INFO networking_nsxv3.common.synchronization [None req-708925a6-28c5-40d5-9861-698c75bda1b9 None None] Enqueued Resource ID: 770da5eb-6f76-4714-a950-b6ab51fc015e with Priority: HIGHEST for action port [ 672.741247] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 770da5eb-6f76-4714-a950-b6ab51fc015e with Priority: HIGHEST for action port [ 672.741247] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-770da5eb-6f76-4714-a950-b6ab51fc015e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.741247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-770da5eb-6f76-4714-a950-b6ab51fc015e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.741247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-770da5eb-6f76-4714-a950-b6ab51fc015e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.742401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-770da5eb-6f76-4714-a950-b6ab51fc015e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.743476] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('770da5eb-6f76-4714-a950-b6ab51fc015e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.800757] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.800916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.800987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.801235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.801325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.801423] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be updated. [ 672.809560] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.809750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.809911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.810112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.810235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.810524] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.810677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.810770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.810961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.811078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.811192] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 is going to be updated. [ 672.843024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.843024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.843024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.843024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.843024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.853562] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.853562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.853562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.853562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.853562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.855884] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: IN_PROGRESS for 2s [ 672.860044] env[69777]: INFO networking_nsxv3.common.synchronization [req-4ad19969-d4c5-47dd-9a6f-b94b74719f9b req-897653be-3a51-4267-b4b3-b493d88edb63 service nova] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_rules [ 672.860044] env[69777]: INFO networking_nsxv3.common.synchronization [req-4ad19969-d4c5-47dd-9a6f-b94b74719f9b req-897653be-3a51-4267-b4b3-b493d88edb63 service nova] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 672.860044] env[69777]: INFO networking_nsxv3.common.synchronization [req-4ad19969-d4c5-47dd-9a6f-b94b74719f9b req-897653be-3a51-4267-b4b3-b493d88edb63 service nova] Enqueued Resource ID: 3aa8e09e-0b75-4465-ab80-06de46ffc667 with Priority: HIGHEST for action port [ 672.860044] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_rules [ 672.860044] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 672.860044] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aa8e09e-0b75-4465-ab80-06de46ffc667 with Priority: HIGHEST for action port [ 672.860727] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.861036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.862008] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.862224] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.862566] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-3aa8e09e-0b75-4465-ab80-06de46ffc667 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.862813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3aa8e09e-0b75-4465-ab80-06de46ffc667" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.862978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3aa8e09e-0b75-4465-ab80-06de46ffc667" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.863346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3aa8e09e-0b75-4465-ab80-06de46ffc667" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.863532] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aa8e09e-0b75-4465-ab80-06de46ffc667',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.866235] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: IN_PROGRESS for 2s [ 672.970761] env[69777]: INFO networking_nsxv3.common.synchronization [None req-3faed337-ffcc-4076-997d-3f1e51f911cd None None] Enqueued Resource ID: 82db8fd2-f6c1-4d48-a125-02687b7a863c with Priority: HIGHEST for action port [ 672.971426] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82db8fd2-f6c1-4d48-a125-02687b7a863c with Priority: HIGHEST for action port [ 672.972078] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-82db8fd2-f6c1-4d48-a125-02687b7a863c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.972078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82db8fd2-f6c1-4d48-a125-02687b7a863c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.975306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82db8fd2-f6c1-4d48-a125-02687b7a863c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.976415] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82db8fd2-f6c1-4d48-a125-02687b7a863c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.976548] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82db8fd2-f6c1-4d48-a125-02687b7a863c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.100623] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ae13a8f-189d-4636-93d9-db49dd6a7ded [ 673.101129] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.101578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.101658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.101877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.101969] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.102083] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ae13a8f-189d-4636-93d9-db49dd6a7ded already deleted. [ 673.102176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ae13a8f-189d-4636-93d9-db49dd6a7ded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.113095] env[69777]: INFO networking_nsxv3.common.synchronization [req-bffe3e9b-7fc1-4860-9efc-441aecd05e43 req-55483e95-c662-45a6-83e7-12c0fa604178 tempest-ImagesNegativeTestJSON-1415695133 tempest-ImagesNegativeTestJSON-1415695133-project-member] Enqueued Resource ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 with Priority: HIGHEST for action security_group_members [ 673.113484] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 with Priority: HIGHEST for action security_group_members [ 673.113775] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-08af296d-bf45-410a-a0dc-29f3c9a17a13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.113866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.113866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.114996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.114996] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.117256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.117256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.117256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.117256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.117256] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08af296d-bf45-410a-a0dc-29f3c9a17a13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.118063] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.118291] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.118446] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.120334] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.120589] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.120663] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 60625715-cfae-46d3-bb1e-ec53ce638f44 not found, creating... [ 673.121057] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.121233] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.121433] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.121596] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.122565] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.126022] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.126022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.126022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.126022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.126022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.126022] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 60625715-cfae-46d3-bb1e-ec53ce638f44 is going to be created. [ 673.149803] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.149803] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.149803] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.150062] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.150383] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.150689] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-60625715-cfae-46d3-bb1e-ec53ce638f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.245342] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 770da5eb-6f76-4714-a950-b6ab51fc015e [ 673.245477] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.246143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.247154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.247154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.247297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.247411] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:770da5eb-6f76-4714-a950-b6ab51fc015e already deleted. [ 673.247502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-770da5eb-6f76-4714-a950-b6ab51fc015e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.367277] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3aa8e09e-0b75-4465-ab80-06de46ffc667 with status ACTIVE [ 673.367541] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.367684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.367770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.368432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.368432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.368432] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.368432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.368432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.368693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.368693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.368886] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.368975] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.369577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.370147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.370147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.370147] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3aa8e09e-0b75-4465-ab80-06de46ffc667 is going to be updated. [ 673.390046] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.390158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.390233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.390423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.390568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.390767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3aa8e09e-0b75-4465-ab80-06de46ffc667" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.481190] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82db8fd2-f6c1-4d48-a125-02687b7a863c [ 673.481430] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.481567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.482400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.482400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.482400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.482400] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82db8fd2-f6c1-4d48-a125-02687b7a863c already deleted. [ 673.482400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82db8fd2-f6c1-4d48-a125-02687b7a863c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.633488] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.633488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.633488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.633488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.633488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.633488] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.633488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.633488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.633488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.633488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.635337] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 already deleted. [ 673.635337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.948754] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 673.949400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.949856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.953900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.953900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.953900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.953900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.955497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.955497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.959126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.959126] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.279635] env[69777]: INFO networking_nsxv3.common.synchronization [None req-52f8054e-70b5-4e08-bd73-22368b6947ab None None] Enqueued Resource ID: d45d052d-a7c9-4682-be27-2052de90a939 with Priority: HIGHEST for action port [ 674.279635] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d45d052d-a7c9-4682-be27-2052de90a939 with Priority: HIGHEST for action port [ 674.279635] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d45d052d-a7c9-4682-be27-2052de90a939 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.279635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d45d052d-a7c9-4682-be27-2052de90a939" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.279635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d45d052d-a7c9-4682-be27-2052de90a939" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.280782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d45d052d-a7c9-4682-be27-2052de90a939" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.281149] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d45d052d-a7c9-4682-be27-2052de90a939',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.460769] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e: rpc.has_security_group_logging(os_id): False [ 674.483239] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.483406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.483888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.484424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.484586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.485180] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.485180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.485180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.485309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.485469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.486507] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.486714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.486815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.486990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.488645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.488645] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.488645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.488645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.488922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.488922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.489020] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be created. [ 674.545583] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.545834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.545834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.546109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.546297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.562269] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 674.636485] env[69777]: INFO networking_nsxv3.common.synchronization [req-b9f158d3-bffa-4de2-b27a-e227fef4b8be req-8c188346-f9e0-4172-9065-63303400f10a service nova] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_rules [ 674.636485] env[69777]: INFO networking_nsxv3.common.synchronization [req-b9f158d3-bffa-4de2-b27a-e227fef4b8be req-8c188346-f9e0-4172-9065-63303400f10a service nova] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 674.636485] env[69777]: INFO networking_nsxv3.common.synchronization [req-b9f158d3-bffa-4de2-b27a-e227fef4b8be req-8c188346-f9e0-4172-9065-63303400f10a service nova] Enqueued Resource ID: 60625715-cfae-46d3-bb1e-ec53ce638f44 with Priority: HIGHEST for action port [ 674.636485] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_rules [ 674.636485] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 674.636485] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60625715-cfae-46d3-bb1e-ec53ce638f44 with Priority: HIGHEST for action port [ 674.640815] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.640815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.641909] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.642454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.644749] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-60625715-cfae-46d3-bb1e-ec53ce638f44 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.644749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60625715-cfae-46d3-bb1e-ec53ce638f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.644749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60625715-cfae-46d3-bb1e-ec53ce638f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.644749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60625715-cfae-46d3-bb1e-ec53ce638f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.644749] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60625715-cfae-46d3-bb1e-ec53ce638f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.785828] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d45d052d-a7c9-4682-be27-2052de90a939 [ 674.785828] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.785828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.785828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.785828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.785828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.785828] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d45d052d-a7c9-4682-be27-2052de90a939 already deleted. [ 674.785828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d45d052d-a7c9-4682-be27-2052de90a939" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.868045] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: SUCCESS [ 674.868241] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 deletion is rescheduled due to dependency. [ 674.868360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.876595] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 674.876595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.879949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.879949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.879949] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.879949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.879949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.879949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.879949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.879949] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.066662] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-261 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.066865] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-261" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.066991] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-261" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.067365] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-261" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.067637] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.067795] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.067911] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.068445] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.068445] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.068678] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.068766] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.068858] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.068961] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.069224] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.069331] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.069458] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.086628] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.086965] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 675.086965] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.087111] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-261" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.089287] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-b6b06cb0-2466-4fdd-ad16-913cfb19c105 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.089287] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-b6b06cb0-2466-4fdd-ad16-913cfb19c105" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.089287] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-b6b06cb0-2466-4fdd-ad16-913cfb19c105" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.089768] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-b6b06cb0-2466-4fdd-ad16-913cfb19c105" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.090066] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6b06cb0-2466-4fdd-ad16-913cfb19c105',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.151277] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60625715-cfae-46d3-bb1e-ec53ce638f44 with status ACTIVE [ 675.151277] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.151277] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.151277] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.151277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.152822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.153114] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60625715-cfae-46d3-bb1e-ec53ce638f44 is going to be updated. [ 675.178295] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.178295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.178295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.178295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.178295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.178295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60625715-cfae-46d3-bb1e-ec53ce638f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.216492] env[69777]: INFO networking_nsxv3.common.synchronization [None req-8878ae9b-f494-4c66-975a-614ac0fc3b21 None None] Enqueued Resource ID: 5acc19dd-0e5b-4fcd-afbb-9092315367d9 with Priority: HIGHEST for action port [ 675.218096] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5acc19dd-0e5b-4fcd-afbb-9092315367d9 with Priority: HIGHEST for action port [ 675.218428] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-5acc19dd-0e5b-4fcd-afbb-9092315367d9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.218557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5acc19dd-0e5b-4fcd-afbb-9092315367d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.218623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5acc19dd-0e5b-4fcd-afbb-9092315367d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.218872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5acc19dd-0e5b-4fcd-afbb-9092315367d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.218952] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5acc19dd-0e5b-4fcd-afbb-9092315367d9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.385746] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.596575] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.596575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.596575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.596575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.596575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.596575] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port b6b06cb0-2466-4fdd-ad16-913cfb19c105 not found, creating... [ 675.596575] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.596575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.596575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.596575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.596575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.597085] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.597085] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.597085] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.598953] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.599765] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.600035] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: b6b06cb0-2466-4fdd-ad16-913cfb19c105 is going to be created. [ 675.619187] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.619411] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.619535] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.619823] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.620723] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.620723] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-b6b06cb0-2466-4fdd-ad16-913cfb19c105" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.721523] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5acc19dd-0e5b-4fcd-afbb-9092315367d9 [ 675.721828] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.722548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.722548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.722688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.722688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.722780] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5acc19dd-0e5b-4fcd-afbb-9092315367d9 already deleted. [ 675.722858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5acc19dd-0e5b-4fcd-afbb-9092315367d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.888611] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.375295] env[69777]: INFO networking_nsxv3.common.synchronization [None req-1ab90443-1f74-4be8-a34e-e3e5820fb00d tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_rules [ 676.375295] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_rules [ 676.375295] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.375295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.375295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.375295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.375295] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.392141] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.394552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.394552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.394552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.394552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.394552] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be updated. [ 676.423781] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.423781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.423781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.423781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.423781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.435343] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: IN_PROGRESS for 2s [ 676.583081] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 676.583374] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.583501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.583785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.583891] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.902044] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.902044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.902044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.902044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.902044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.902044] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 already deleted. [ 676.902044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.949575] env[69777]: INFO networking_nsxv3.common.synchronization [req-bffe3e9b-7fc1-4860-9efc-441aecd05e43 req-ddff667b-8895-434c-9538-f7f1f635b13d service nova] Enqueued Resource ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 with Priority: HIGHEST for action security_group_rules [ 676.949800] env[69777]: INFO networking_nsxv3.common.synchronization [req-bffe3e9b-7fc1-4860-9efc-441aecd05e43 req-ddff667b-8895-434c-9538-f7f1f635b13d service nova] Enqueued Resource ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 with Priority: HIGHEST for action security_group_members [ 676.949914] env[69777]: INFO networking_nsxv3.common.synchronization [req-bffe3e9b-7fc1-4860-9efc-441aecd05e43 req-ddff667b-8895-434c-9538-f7f1f635b13d service nova] Enqueued Resource ID: b6b06cb0-2466-4fdd-ad16-913cfb19c105 with Priority: HIGHEST for action port [ 676.950491] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 with Priority: HIGHEST for action security_group_rules [ 676.950698] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 with Priority: HIGHEST for action security_group_members [ 676.950756] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6b06cb0-2466-4fdd-ad16-913cfb19c105 with Priority: HIGHEST for action port [ 676.951399] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08af296d-bf45-410a-a0dc-29f3c9a17a13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.951656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.951656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.951988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.952104] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08af296d-bf45-410a-a0dc-29f3c9a17a13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.954244] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-08af296d-bf45-410a-a0dc-29f3c9a17a13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.954426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.954575] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.954743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.954956] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.955069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.955185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.955381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.955542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.955642] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08af296d-bf45-410a-a0dc-29f3c9a17a13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.956920] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6b06cb0-2466-4fdd-ad16-913cfb19c105 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.956920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6b06cb0-2466-4fdd-ad16-913cfb19c105" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.956920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6b06cb0-2466-4fdd-ad16-913cfb19c105" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.957346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6b06cb0-2466-4fdd-ad16-913cfb19c105" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.957346] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6b06cb0-2466-4fdd-ad16-913cfb19c105',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.000396] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a7d3b721-00d3-46ed-aadf-de94ec5f01fa tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_rules [ 677.000964] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_rules [ 677.001294] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.001464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.001600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.001886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.002463] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.089252] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.089252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.089557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.089598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.089772] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.089954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.089954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.090546] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.090546] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.090546] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.090693] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.296379] env[69777]: INFO networking_nsxv3.common.synchronization [None req-8b64a45d-ff07-4ff0-9ec8-59ef81cd7c92 None None] Enqueued Resource ID: 6d1d14e7-2703-4f14-acbe-fb90aedf4e1d with Priority: HIGHEST for action port [ 677.296923] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d1d14e7-2703-4f14-acbe-fb90aedf4e1d with Priority: HIGHEST for action port [ 677.297121] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d1d14e7-2703-4f14-acbe-fb90aedf4e1d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.297317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d1d14e7-2703-4f14-acbe-fb90aedf4e1d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.297317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d1d14e7-2703-4f14-acbe-fb90aedf4e1d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.297560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d1d14e7-2703-4f14-acbe-fb90aedf4e1d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.297633] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d1d14e7-2703-4f14-acbe-fb90aedf4e1d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.460474] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-08af296d-bf45-410a-a0dc-29f3c9a17a13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.460474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.460474] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08af296d-bf45-410a-a0dc-29f3c9a17a13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.461112] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6b06cb0-2466-4fdd-ad16-913cfb19c105 with status ACTIVE [ 677.461315] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.461501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.461719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.461864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.461931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.462093] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.462220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.462274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.462455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.462455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.462755] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.462755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.462937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.462937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.463036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.463396] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6b06cb0-2466-4fdd-ad16-913cfb19c105 is going to be updated. [ 677.490447] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.490447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.490447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.490447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.490447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.490447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6b06cb0-2466-4fdd-ad16-913cfb19c105" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.526925] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.526925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.526925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.526925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.526925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.526925] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 already deleted. [ 677.526925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.591602] env[69777]: INFO networking_nsxv3.common.synchronization [None req-aa50d774-8680-4cdf-928e-c573cdbd5935 None None] Enqueued Resource ID: 482385ca-b811-4a22-ac70-3807c495bdad with Priority: HIGHEST for action port [ 677.591724] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482385ca-b811-4a22-ac70-3807c495bdad with Priority: HIGHEST for action port [ 677.593108] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-482385ca-b811-4a22-ac70-3807c495bdad taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.593285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-482385ca-b811-4a22-ac70-3807c495bdad" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.593363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-482385ca-b811-4a22-ac70-3807c495bdad" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.593629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-482385ca-b811-4a22-ac70-3807c495bdad" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.593824] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('482385ca-b811-4a22-ac70-3807c495bdad',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.594710] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.595112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.595112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.595112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.595269] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.595379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.595497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.595928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.595928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.596035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.596283] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.596340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.596443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.596549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.596949] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.596949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.597060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.599333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.599333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.599333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.599333] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.765874] env[69777]: INFO networking_nsxv3.common.synchronization [None req-6c00abb4-97c3-438a-85ab-4c12ab80becd None None] Enqueued Resource ID: 26a65cf1-d1f6-43a1-b9a6-dd77558b8d03 with Priority: HIGHEST for action port [ 677.766110] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26a65cf1-d1f6-43a1-b9a6-dd77558b8d03 with Priority: HIGHEST for action port [ 677.766664] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-26a65cf1-d1f6-43a1-b9a6-dd77558b8d03 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.767381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26a65cf1-d1f6-43a1-b9a6-dd77558b8d03" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.767611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26a65cf1-d1f6-43a1-b9a6-dd77558b8d03" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.768337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26a65cf1-d1f6-43a1-b9a6-dd77558b8d03" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.768337] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26a65cf1-d1f6-43a1-b9a6-dd77558b8d03',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.807209] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d1d14e7-2703-4f14-acbe-fb90aedf4e1d [ 677.807209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.807724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.807724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.808347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.808347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.808347] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d1d14e7-2703-4f14-acbe-fb90aedf4e1d already deleted. [ 677.808347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d1d14e7-2703-4f14-acbe-fb90aedf4e1d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.965735] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08af296d-bf45-410a-a0dc-29f3c9a17a13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.103047] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 482385ca-b811-4a22-ac70-3807c495bdad [ 678.103047] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.103047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.103047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.103047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.103047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.103047] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:482385ca-b811-4a22-ac70-3807c495bdad already deleted. [ 678.103047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-482385ca-b811-4a22-ac70-3807c495bdad" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.103047] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e: rpc.has_security_group_logging(os_id): False [ 678.126922] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.126922] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.126922] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.126922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.127713] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.127713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.127713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.127713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.127713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.127713] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 678.144250] env[69777]: INFO networking_nsxv3.common.synchronization [None req-2874a160-41e0-43c5-8d46-981a7ff65dda None None] Enqueued Resource ID: 042ee7e2-dff0-4e80-95ec-22d2e54385a9 with Priority: HIGHEST for action port [ 678.144380] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042ee7e2-dff0-4e80-95ec-22d2e54385a9 with Priority: HIGHEST for action port [ 678.147376] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-042ee7e2-dff0-4e80-95ec-22d2e54385a9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.147376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-042ee7e2-dff0-4e80-95ec-22d2e54385a9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.147376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-042ee7e2-dff0-4e80-95ec-22d2e54385a9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.147376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-042ee7e2-dff0-4e80-95ec-22d2e54385a9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.147376] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('042ee7e2-dff0-4e80-95ec-22d2e54385a9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.185436] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.185436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.185436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.185436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.185436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.194909] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 678.271038] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26a65cf1-d1f6-43a1-b9a6-dd77558b8d03 [ 678.271386] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.271386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.271386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.271599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.271917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.271917] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26a65cf1-d1f6-43a1-b9a6-dd77558b8d03 already deleted. [ 678.271917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26a65cf1-d1f6-43a1-b9a6-dd77558b8d03" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.448381] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 678.448662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.448785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.449032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.449218] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.449396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.449396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.453153] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.453153] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.453153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.453153] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.453854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.453854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.454349] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.454349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.454349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.454550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.454623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.455038] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.471858] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.471858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.471858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.471858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.471858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.471858] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 is going to be created. [ 678.495278] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.495278] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.495278] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.495446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.495483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.507843] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 in Status: UNINITIALIZED for 2s [ 678.527033] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a41edf10-27b2-45cf-8b1c-81529bcf45e3 tempest-ServersTestJSON-413471657 tempest-ServersTestJSON-413471657-project-member] Enqueued Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_rules [ 678.528056] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_rules [ 678.530379] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f2530c-f805-4944-9fb5-070cda7bf623 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.530379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.530379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.530379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.530379] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.650966] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 042ee7e2-dff0-4e80-95ec-22d2e54385a9 [ 678.652779] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.652779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.652779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.652779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.652779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.652779] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:042ee7e2-dff0-4e80-95ec-22d2e54385a9 already deleted. [ 678.652779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-042ee7e2-dff0-4e80-95ec-22d2e54385a9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.736060] env[69777]: INFO networking_nsxv3.common.synchronization [None req-1d9b3384-8799-43a7-9ce7-70ad46feac57 tempest-ServersTestJSON-413471657 tempest-ServersTestJSON-413471657-project-member] Enqueued Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_rules [ 678.736660] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_rules [ 678.736980] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f2530c-f805-4944-9fb5-070cda7bf623 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.743553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.958901] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54ece09a-8f35-4152-a654-20e3b05650f5: rpc.has_security_group_logging(os_id): False [ 678.959099] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.977089] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.978333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.978679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.981020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.981020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.981020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.981020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.981020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.988872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.988872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.988872] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.988872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.988872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.988872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.988872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.988872] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.988872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.988872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.988872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.988872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.988872] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be created. [ 679.043873] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.045044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.045044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.045044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.045044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.053585] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.053585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.053585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.053585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.053585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.053585] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f2530c-f805-4944-9fb5-070cda7bf623 already deleted. [ 679.053585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.053585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.053585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.053585] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.058893] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: IN_PROGRESS for 2s [ 679.219885] env[69777]: INFO networking_nsxv3.common.synchronization [None req-1f2dc463-98c0-4e5b-b036-0c8e347ad8ce None None] Enqueued Resource ID: 333fb3bf-8a96-404d-a033-7f46ba0a53c0 with Priority: HIGHEST for action port [ 679.220163] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333fb3bf-8a96-404d-a033-7f46ba0a53c0 with Priority: HIGHEST for action port [ 679.222120] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-333fb3bf-8a96-404d-a033-7f46ba0a53c0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.222120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-333fb3bf-8a96-404d-a033-7f46ba0a53c0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.222120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-333fb3bf-8a96-404d-a033-7f46ba0a53c0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.222120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-333fb3bf-8a96-404d-a033-7f46ba0a53c0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.222298] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('333fb3bf-8a96-404d-a033-7f46ba0a53c0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.346534] env[69777]: INFO networking_nsxv3.common.synchronization [req-7ff711c6-eded-4be3-8d97-a1019dcf8e89 req-9447bc64-2d05-4248-be9f-4b6ffc034ac4 tempest-ServerExternalEventsTest-1232251863 tempest-ServerExternalEventsTest-1232251863-project-member] Enqueued Resource ID: 34d3f208-bbb4-4415-9934-a2683e967524 with Priority: HIGHEST for action security_group_members [ 679.346534] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d3f208-bbb4-4415-9934-a2683e967524 with Priority: HIGHEST for action security_group_members [ 679.346534] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d3f208-bbb4-4415-9934-a2683e967524 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.346866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.346866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.346866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.347026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.349757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.349757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.349757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.349757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.349757] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34d3f208-bbb4-4415-9934-a2683e967524',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.463445] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.534276] env[69777]: INFO networking_nsxv3.common.synchronization [None req-6ee8cb06-c0a7-4ffa-836a-192dc00a5e54 None None] Enqueued Resource ID: e870e797-ee45-442c-9e1a-fbd611496646 with Priority: HIGHEST for action port [ 679.535644] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e870e797-ee45-442c-9e1a-fbd611496646 with Priority: HIGHEST for action port [ 679.536888] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-e870e797-ee45-442c-9e1a-fbd611496646 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.536888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e870e797-ee45-442c-9e1a-fbd611496646" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.541617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e870e797-ee45-442c-9e1a-fbd611496646" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.541617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e870e797-ee45-442c-9e1a-fbd611496646" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.541617] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e870e797-ee45-442c-9e1a-fbd611496646',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.575496] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.575658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.575725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.575915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.575998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.576105] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f2530c-f805-4944-9fb5-070cda7bf623 already deleted. [ 679.576188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.678512] env[69777]: INFO networking_nsxv3.common.synchronization [req-1dc6ce72-23c1-48ac-9f18-8f253536c98b req-bc1d6f81-ec11-493d-9216-a7b1d5c36310 tempest-AttachInterfacesV270Test-1559009987 tempest-AttachInterfacesV270Test-1559009987-project-member] Enqueued Resource ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a with Priority: HIGHEST for action security_group_members [ 679.680559] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a with Priority: HIGHEST for action security_group_members [ 679.680559] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd70cffe-95a5-47b4-9c07-a7316a03b88a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.680559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.680559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.680559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.680986] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.681222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.681372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.681616] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.681793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.682428] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd70cffe-95a5-47b4-9c07-a7316a03b88a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.725165] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 333fb3bf-8a96-404d-a033-7f46ba0a53c0 [ 679.725165] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.725165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.725165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.725646] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.725646] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.725646] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:333fb3bf-8a96-404d-a033-7f46ba0a53c0 already deleted. [ 679.725646] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-333fb3bf-8a96-404d-a033-7f46ba0a53c0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.851500] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.851702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.851796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.852078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.852186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.852392] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.852507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.853134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.853445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.853641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.853842] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d3f208-bbb4-4415-9934-a2683e967524 is going to be updated. [ 679.881957] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.881957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.881957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.881957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.881957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.888857] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d3f208-bbb4-4415-9934-a2683e967524 in Status: IN_PROGRESS for 2s [ 679.969838] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.969838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.969838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.969838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.969838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.969838] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be updated. [ 679.997956] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.998270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.998378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.998761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.000092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.009690] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: IN_PROGRESS for 2s [ 680.043953] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e870e797-ee45-442c-9e1a-fbd611496646 [ 680.044258] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.044384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.044506] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.044741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.044859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.044976] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e870e797-ee45-442c-9e1a-fbd611496646 already deleted. [ 680.045283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e870e797-ee45-442c-9e1a-fbd611496646" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.185127] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.189430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.189685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.189767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.189871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.190355] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.190355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.190593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.190593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.190736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.190736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a is going to be updated. [ 680.210237] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 680.213540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.219973] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.219973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.219973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.219973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.219973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.228141] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a in Status: IN_PROGRESS for 2s [ 680.585295] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 in Status: SUCCESS [ 680.585295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.585498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.585853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.585853] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.586089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.586089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.586218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.586338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.586431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.586527] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08af296d-bf45-410a-a0dc-29f3c9a17a13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.071511] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 681.073764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.073764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.073764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.073764] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.091522] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-08af296d-bf45-410a-a0dc-29f3c9a17a13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.095955] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.095955] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-08af296d-bf45-410a-a0dc-29f3c9a17a13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.095955] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.095955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.097140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.097140] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08af296d-bf45-410a-a0dc-29f3c9a17a13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.576795] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.580386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.600075] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08af296d-bf45-410a-a0dc-29f3c9a17a13: rpc.has_security_group_logging(os_id): False [ 681.618194] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.619152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.619152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.619152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.619152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.619152] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.619152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.619152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.619632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.619632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.619632] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.619632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.619632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.619855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.619855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.623606] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.623606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.623606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.623606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.623606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.624598] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 is going to be created. [ 681.680518] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.680926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.681246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.681469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.681655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.693466] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 in Status: IN_PROGRESS for 2s [ 681.843184] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a472925-3b63-47c1-a80c-9a0f882b256e req-ccd15fe7-48c6-4c88-b2d3-d9f7cb92da6b tempest-VolumesAssistedSnapshotsTest-134890089 tempest-VolumesAssistedSnapshotsTest-134890089-project-member] Enqueued Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_members [ 681.844241] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_members [ 681.845883] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1512ec-3cb3-4a3e-9626-035d7eea4067 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.846311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.846547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.846834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.847715] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.847962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.848291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.848797] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.848954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.849251] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c1512ec-3cb3-4a3e-9626-035d7eea4067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.901353] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d3f208-bbb4-4415-9934-a2683e967524 in Status: SUCCESS [ 681.901528] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d3f208-bbb4-4415-9934-a2683e967524 deletion is rescheduled due to dependency. [ 681.901732] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d3f208-bbb4-4415-9934-a2683e967524" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.021210] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 682.021497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.021574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.021773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.021980] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.022178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.022178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.022333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.022415] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.022511] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.238787] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a in Status: SUCCESS [ 682.238787] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a deletion is rescheduled due to dependency. [ 682.239124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.353761] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.354083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.354544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.355376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.355517] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.355785] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.355918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.355988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.356176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.356277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.356374] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 already deleted. [ 682.356449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.397126] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-42 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.397126] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-42" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.397126] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-42" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.397126] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-42" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.397382] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.397382] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.397500] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.397994] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.397994] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.398150] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.398248] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.398357] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.398483] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.399417] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.399417] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.399417] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.420350] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.420350] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.420350] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.420350] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-42" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.420350] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-43576d7b-b1df-483f-a85a-f55f3479348d taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.420350] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-43576d7b-b1df-483f-a85a-f55f3479348d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.420350] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-43576d7b-b1df-483f-a85a-f55f3479348d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.420350] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-43576d7b-b1df-483f-a85a-f55f3479348d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.420350] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43576d7b-b1df-483f-a85a-f55f3479348d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.528047] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.924608] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.924608] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.924801] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.925077] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.925350] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.925642] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 43576d7b-b1df-483f-a85a-f55f3479348d not found, creating... [ 682.925987] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.926370] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.926528] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.926863] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.926936] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.927612] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.928208] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.928208] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.928208] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.928428] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.928428] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 43576d7b-b1df-483f-a85a-f55f3479348d is going to be created. [ 682.949445] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.949976] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.950178] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.954210] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.954687] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.954933] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-43576d7b-b1df-483f-a85a-f55f3479348d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.029251] env[69777]: INFO networking_nsxv3.common.synchronization [None req-58163ac1-bf45-492e-abc3-1234cd04b1ac None None] Enqueued Resource ID: aaf44c70-5c46-457c-90b7-2dfd0dd960f4 with Priority: HIGHEST for action port [ 683.029689] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.030628] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf44c70-5c46-457c-90b7-2dfd0dd960f4 with Priority: HIGHEST for action port [ 683.031868] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaf44c70-5c46-457c-90b7-2dfd0dd960f4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.032033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaf44c70-5c46-457c-90b7-2dfd0dd960f4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.032321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaf44c70-5c46-457c-90b7-2dfd0dd960f4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.032792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaf44c70-5c46-457c-90b7-2dfd0dd960f4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.032792] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaf44c70-5c46-457c-90b7-2dfd0dd960f4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.138272] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a65bb6d6-a192-4b4b-98c7-ff82fefb5a91 None None] Enqueued Resource ID: f182f62a-9bb7-437f-b665-2577ec6e5256 with Priority: HIGHEST for action port [ 683.138272] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f182f62a-9bb7-437f-b665-2577ec6e5256 with Priority: HIGHEST for action port [ 683.138272] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f182f62a-9bb7-437f-b665-2577ec6e5256 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.138272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f182f62a-9bb7-437f-b665-2577ec6e5256" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.138272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f182f62a-9bb7-437f-b665-2577ec6e5256" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.138272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f182f62a-9bb7-437f-b665-2577ec6e5256" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.138272] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f182f62a-9bb7-437f-b665-2577ec6e5256',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.532309] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.532591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.532591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.533394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.533583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.533885] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be updated. [ 683.535090] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaf44c70-5c46-457c-90b7-2dfd0dd960f4 [ 683.536126] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.536299] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.536987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.537387] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.537636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.537907] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaf44c70-5c46-457c-90b7-2dfd0dd960f4 already deleted. [ 683.538052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaf44c70-5c46-457c-90b7-2dfd0dd960f4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.569923] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.570136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.570189] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.570365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.570512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.581113] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: IN_PROGRESS for 2s [ 683.643174] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f182f62a-9bb7-437f-b665-2577ec6e5256 [ 683.646018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.646018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.646018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.646018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.646018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.646018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f182f62a-9bb7-437f-b665-2577ec6e5256 already deleted. [ 683.646018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f182f62a-9bb7-437f-b665-2577ec6e5256" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.707080] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 in Status: SUCCESS [ 683.707364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.288500] env[69777]: INFO networking_nsxv3.common.synchronization [req-e83f56ac-15a5-47e8-b969-7cb694a125ab req-b1deb240-7d82-460c-939d-1525d73fa69d tempest-ImagesTestJSON-42450789 tempest-ImagesTestJSON-42450789-project-member] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 684.289122] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 684.290269] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.290269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.290269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.290269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.290630] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.290630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.290630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.290777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.290777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.290874] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.439615] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a472925-3b63-47c1-a80c-9a0f882b256e req-8c9b29f9-03fc-4078-9f91-26f2bf7c53f4 service nova] Enqueued Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_rules [ 684.439807] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a472925-3b63-47c1-a80c-9a0f882b256e req-8c9b29f9-03fc-4078-9f91-26f2bf7c53f4 service nova] Enqueued Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_members [ 684.439934] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a472925-3b63-47c1-a80c-9a0f882b256e req-8c9b29f9-03fc-4078-9f91-26f2bf7c53f4 service nova] Enqueued Resource ID: 43576d7b-b1df-483f-a85a-f55f3479348d with Priority: HIGHEST for action port [ 684.440178] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_rules [ 684.440322] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_members [ 684.440420] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43576d7b-b1df-483f-a85a-f55f3479348d with Priority: HIGHEST for action port [ 684.440967] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.441139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.441213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.441399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.441480] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c1512ec-3cb3-4a3e-9626-035d7eea4067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.442650] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1512ec-3cb3-4a3e-9626-035d7eea4067 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.442650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.442832] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.442896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.443061] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.443155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.443208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.443322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.443400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.443524] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c1512ec-3cb3-4a3e-9626-035d7eea4067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.444229] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-43576d7b-b1df-483f-a85a-f55f3479348d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.444755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43576d7b-b1df-483f-a85a-f55f3479348d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.444755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43576d7b-b1df-483f-a85a-f55f3479348d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.444755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43576d7b-b1df-483f-a85a-f55f3479348d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.444755] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43576d7b-b1df-483f-a85a-f55f3479348d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.798551] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.798852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.798852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.798990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.799092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.799292] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.799385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.799445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.799590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.799662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.799741] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 already deleted. [ 684.799816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.950512] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1512ec-3cb3-4a3e-9626-035d7eea4067 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.951446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.951652] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c1512ec-3cb3-4a3e-9626-035d7eea4067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.952888] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43576d7b-b1df-483f-a85a-f55f3479348d with status ACTIVE [ 684.952888] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.952888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.952888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.953181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.953181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.953396] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.953470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.953513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.954292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.954292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.954292] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.954292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.956790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.959577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.959653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.959750] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43576d7b-b1df-483f-a85a-f55f3479348d is going to be updated. [ 684.979777] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.979923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.979986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.980208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.980340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.980503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43576d7b-b1df-483f-a85a-f55f3479348d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.197404] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.197616] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.197740] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.198080] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.198348] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.198499] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.198613] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.198829] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.198965] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.199485] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.199485] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.199485] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.199636] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.199685] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.199781] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.199913] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.218418] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.218710] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 685.218910] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.219184] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.221746] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-d150ee09-dd8a-4d63-8c0f-e16fc48459d2 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.221746] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-d150ee09-dd8a-4d63-8c0f-e16fc48459d2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.221746] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-d150ee09-dd8a-4d63-8c0f-e16fc48459d2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.221746] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-d150ee09-dd8a-4d63-8c0f-e16fc48459d2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.221746] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d150ee09-dd8a-4d63-8c0f-e16fc48459d2',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.462396] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c1512ec-3cb3-4a3e-9626-035d7eea4067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.590596] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 685.591740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.591740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.591740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.591740] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.591740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.591975] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.591975] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.592084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.592369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.592369] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.724331] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.724575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.724705] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.724994] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.725161] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.725307] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port d150ee09-dd8a-4d63-8c0f-e16fc48459d2 not found, creating... [ 685.730192] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.730192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.730192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.730192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.730192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.730192] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.730192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.730192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.730192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.730192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.730771] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: d150ee09-dd8a-4d63-8c0f-e16fc48459d2 is going to be created. [ 685.748199] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.748199] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.748426] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.748697] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.749204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.749497] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-d150ee09-dd8a-4d63-8c0f-e16fc48459d2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.872273] env[69777]: INFO networking_nsxv3.common.synchronization [None req-1860ffef-9a93-4af7-8514-76aba79c5435 None None] Enqueued Resource ID: 5c4c3353-c657-460b-80b5-f1cf2a9b5da1 with Priority: HIGHEST for action port [ 685.874044] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c4c3353-c657-460b-80b5-f1cf2a9b5da1 with Priority: HIGHEST for action port [ 685.874979] env[69777]: INFO networking_nsxv3.common.synchronization [None req-bbd21977-ee67-44d9-a4db-734822a8bcda None None] Enqueued Resource ID: 4eb3fbad-f29e-4500-853d-250f9701baeb with Priority: HIGHEST for action port [ 685.875673] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c4c3353-c657-460b-80b5-f1cf2a9b5da1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.875673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c4c3353-c657-460b-80b5-f1cf2a9b5da1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.875804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c4c3353-c657-460b-80b5-f1cf2a9b5da1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.876297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c4c3353-c657-460b-80b5-f1cf2a9b5da1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.876297] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c4c3353-c657-460b-80b5-f1cf2a9b5da1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.878172] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb3fbad-f29e-4500-853d-250f9701baeb with Priority: HIGHEST for action port [ 685.878869] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb3fbad-f29e-4500-853d-250f9701baeb taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.879051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb3fbad-f29e-4500-853d-250f9701baeb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.879722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb3fbad-f29e-4500-853d-250f9701baeb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.879722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb3fbad-f29e-4500-853d-250f9701baeb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.879722] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb3fbad-f29e-4500-853d-250f9701baeb',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.966475] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.966475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.966475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.966475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.966475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.966475] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 is going to be created. [ 686.000032] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.000032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.001159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.001159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.001159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.011064] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 in Status: UNINITIALIZED for 2s [ 686.094859] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.095071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.095128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.095327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.097747] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.097747] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.097747] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.097747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.097747] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.381340] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c4c3353-c657-460b-80b5-f1cf2a9b5da1 [ 686.381500] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.381783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.381783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.381920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.382016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.382107] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c4c3353-c657-460b-80b5-f1cf2a9b5da1 already deleted. [ 686.382184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c4c3353-c657-460b-80b5-f1cf2a9b5da1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.382388] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4eb3fbad-f29e-4500-853d-250f9701baeb [ 686.382538] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.382636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.382692] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.382841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.382914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.382994] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4eb3fbad-f29e-4500-853d-250f9701baeb already deleted. [ 686.383081] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb3fbad-f29e-4500-853d-250f9701baeb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.601267] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54ece09a-8f35-4152-a654-20e3b05650f5: rpc.has_security_group_logging(os_id): False [ 686.621927] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.621927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.621927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.622199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.622199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.622425] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.622511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.625019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.625019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.625019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.625019] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be updated. [ 686.680701] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.680857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.680926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.681165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.681365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.699154] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: IN_PROGRESS for 2s [ 686.790609] env[69777]: INFO networking_nsxv3.common.synchronization [None req-d3aa2e84-5ed5-43df-9baa-50231e3a2881 None None] Enqueued Resource ID: dcd59a2c-0da0-4ca2-840b-e3ebdbe8f240 with Priority: HIGHEST for action port [ 686.791322] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd59a2c-0da0-4ca2-840b-e3ebdbe8f240 with Priority: HIGHEST for action port [ 686.791765] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcd59a2c-0da0-4ca2-840b-e3ebdbe8f240 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.791963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcd59a2c-0da0-4ca2-840b-e3ebdbe8f240" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.792104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcd59a2c-0da0-4ca2-840b-e3ebdbe8f240" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.792404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcd59a2c-0da0-4ca2-840b-e3ebdbe8f240" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.793347] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcd59a2c-0da0-4ca2-840b-e3ebdbe8f240',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.185250] env[69777]: INFO networking_nsxv3.common.synchronization [req-e83f56ac-15a5-47e8-b969-7cb694a125ab req-be36948f-83de-46cd-b5e6-056aa8ebd133 service nova] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_rules [ 687.185250] env[69777]: INFO networking_nsxv3.common.synchronization [req-e83f56ac-15a5-47e8-b969-7cb694a125ab req-be36948f-83de-46cd-b5e6-056aa8ebd133 service nova] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 687.185250] env[69777]: INFO networking_nsxv3.common.synchronization [req-e83f56ac-15a5-47e8-b969-7cb694a125ab req-be36948f-83de-46cd-b5e6-056aa8ebd133 service nova] Enqueued Resource ID: d150ee09-dd8a-4d63-8c0f-e16fc48459d2 with Priority: HIGHEST for action port [ 687.185250] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_rules [ 687.185250] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 687.185250] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d150ee09-dd8a-4d63-8c0f-e16fc48459d2 with Priority: HIGHEST for action port [ 687.186673] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.187181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.187342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.188353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.188353] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.191354] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.191354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.191354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.191354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.191354] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.191354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.191354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.191354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.191354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.191354] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.191354] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d150ee09-dd8a-4d63-8c0f-e16fc48459d2 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.191354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d150ee09-dd8a-4d63-8c0f-e16fc48459d2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.191354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d150ee09-dd8a-4d63-8c0f-e16fc48459d2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.192115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d150ee09-dd8a-4d63-8c0f-e16fc48459d2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.192115] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d150ee09-dd8a-4d63-8c0f-e16fc48459d2',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.299991] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcd59a2c-0da0-4ca2-840b-e3ebdbe8f240 [ 687.299991] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.299991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.299991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.299991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.299991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.299991] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcd59a2c-0da0-4ca2-840b-e3ebdbe8f240 already deleted. [ 687.299991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcd59a2c-0da0-4ca2-840b-e3ebdbe8f240" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.412372] env[69777]: INFO networking_nsxv3.common.synchronization [req-da7a4cd4-6a1c-46f8-9144-fddf1a823240 req-9ecfa7cb-0741-4b43-9e38-fe8db98953a7 tempest-ServerDiagnosticsTest-1558728588 tempest-ServerDiagnosticsTest-1558728588-project-member] Enqueued Resource ID: aa84311d-f462-487f-91c4-49b7e8315838 with Priority: HIGHEST for action security_group_members [ 687.412372] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa84311d-f462-487f-91c4-49b7e8315838 with Priority: HIGHEST for action security_group_members [ 687.413071] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa84311d-f462-487f-91c4-49b7e8315838 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.415316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.415316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.415316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.415316] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.415316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.415316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.415316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.415316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.415316] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa84311d-f462-487f-91c4-49b7e8315838',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.699558] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.699558] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.699558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.699558] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d150ee09-dd8a-4d63-8c0f-e16fc48459d2 with status ACTIVE [ 687.699558] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.699558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.699558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.699558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.699558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.699558] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.700194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.700353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.700601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.700787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.702915] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.702915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.702915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.702915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.702915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.702915] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d150ee09-dd8a-4d63-8c0f-e16fc48459d2 is going to be updated. [ 687.729147] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.729328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.729362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.730862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.731100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.731288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d150ee09-dd8a-4d63-8c0f-e16fc48459d2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.927669] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.927983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.928186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.928867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.928867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.928867] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.929065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.929065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.929252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.929740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.929740] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa84311d-f462-487f-91c4-49b7e8315838 already deleted. [ 687.929740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.968082] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.968082] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.968082] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.968082] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.968082] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.968082] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.970950] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.971385] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.971603] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.971897] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.972146] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.972322] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.972533] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.972717] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.972863] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.973054] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.999137] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.999320] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.999485] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.999695] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.000165] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-25f863e8-102c-4e54-b58f-2b8567366d95 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.000415] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-25f863e8-102c-4e54-b58f-2b8567366d95" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.000551] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-25f863e8-102c-4e54-b58f-2b8567366d95" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.000868] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-25f863e8-102c-4e54-b58f-2b8567366d95" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.001591] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25f863e8-102c-4e54-b58f-2b8567366d95',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.022706] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 in Status: SUCCESS [ 688.022706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.022706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.022706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.022706] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.022706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.022706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.022706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.022706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.022706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.022706] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c1512ec-3cb3-4a3e-9626-035d7eea4067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.200051] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.505183] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.505446] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.505568] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.505849] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.505997] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.506161] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 25f863e8-102c-4e54-b58f-2b8567366d95 not found, creating... [ 688.506440] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.506595] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.508017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.508017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.508017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.508017] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.508017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.508017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.510920] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.511034] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.511122] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 25f863e8-102c-4e54-b58f-2b8567366d95 is going to be created. [ 688.516790] env[69777]: INFO networking_nsxv3.common.synchronization [None req-90ea0391-dae7-48fc-8bdd-01adfe00b913 None None] Enqueued Resource ID: 836cf48c-7a2a-4611-8485-ecf1f9d97fbd with Priority: HIGHEST for action port [ 688.516790] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 836cf48c-7a2a-4611-8485-ecf1f9d97fbd with Priority: HIGHEST for action port [ 688.517441] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-836cf48c-7a2a-4611-8485-ecf1f9d97fbd taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.517441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-836cf48c-7a2a-4611-8485-ecf1f9d97fbd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.517595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-836cf48c-7a2a-4611-8485-ecf1f9d97fbd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.519177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-836cf48c-7a2a-4611-8485-ecf1f9d97fbd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.519337] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('836cf48c-7a2a-4611-8485-ecf1f9d97fbd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.525794] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c1512ec-3cb3-4a3e-9626-035d7eea4067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.532639] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.535220] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.535220] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.535220] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.535220] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.535220] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-25f863e8-102c-4e54-b58f-2b8567366d95" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.702034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.702551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.702647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.703200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.703200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.703200] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be created. [ 688.718260] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 688.718722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.719180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.719421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.719535] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.730976] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.731197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.731257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.734912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.734912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.743374] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: UNINITIALIZED for 2s [ 689.022331] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 836cf48c-7a2a-4611-8485-ecf1f9d97fbd [ 689.022595] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.022759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.022828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.023102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.023212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.023326] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:836cf48c-7a2a-4611-8485-ecf1f9d97fbd already deleted. [ 689.023430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-836cf48c-7a2a-4611-8485-ecf1f9d97fbd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.028892] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c1512ec-3cb3-4a3e-9626-035d7eea4067: rpc.has_security_group_logging(os_id): False [ 689.047053] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.047190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.047292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.047554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.048438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.048780] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.048921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.048998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.049278] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.051792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.051792] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 is going to be created. [ 689.143103] env[69777]: INFO networking_nsxv3.common.synchronization [None req-cadd7802-bc64-4bd2-9d53-9ffccc3a4873 None None] Enqueued Resource ID: 35680d37-44b0-4466-a7ab-bb040328c365 with Priority: HIGHEST for action port [ 689.143850] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35680d37-44b0-4466-a7ab-bb040328c365 with Priority: HIGHEST for action port [ 689.144153] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-35680d37-44b0-4466-a7ab-bb040328c365 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.144314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35680d37-44b0-4466-a7ab-bb040328c365" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.144314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35680d37-44b0-4466-a7ab-bb040328c365" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.147499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35680d37-44b0-4466-a7ab-bb040328c365" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.147499] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35680d37-44b0-4466-a7ab-bb040328c365',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.191685] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.192390] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.192978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.193370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.193977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.208299] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 in Status: IN_PROGRESS for 2s [ 689.222821] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.222993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.223074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.223297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.223464] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.223573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.223654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.223830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.223967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.224124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.224124] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.311028] env[69777]: INFO networking_nsxv3.common.synchronization [None req-951da33e-a2ac-46b3-99e6-7c9ff6a4b169 None None] Enqueued Resource ID: 61238573-5d2f-4c27-b3a7-10b2d976b7e6 with Priority: HIGHEST for action port [ 689.311028] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61238573-5d2f-4c27-b3a7-10b2d976b7e6 with Priority: HIGHEST for action port [ 689.314473] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-61238573-5d2f-4c27-b3a7-10b2d976b7e6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.314674] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61238573-5d2f-4c27-b3a7-10b2d976b7e6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.314824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61238573-5d2f-4c27-b3a7-10b2d976b7e6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.315253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61238573-5d2f-4c27-b3a7-10b2d976b7e6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.315390] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61238573-5d2f-4c27-b3a7-10b2d976b7e6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.648761] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35680d37-44b0-4466-a7ab-bb040328c365 [ 689.649041] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.649208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.649662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.649662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.649662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.649768] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35680d37-44b0-4466-a7ab-bb040328c365 already deleted. [ 689.649819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35680d37-44b0-4466-a7ab-bb040328c365" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.728747] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.728938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.729018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.729518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.729518] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.729518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.729719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.729719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.729782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.730061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.730061] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.730144] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.730188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.730313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.730487] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.730534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.730592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.730734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.730813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.730896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.730987] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.824804] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61238573-5d2f-4c27-b3a7-10b2d976b7e6 [ 689.824804] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.824804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.824804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.824804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.824804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.824804] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61238573-5d2f-4c27-b3a7-10b2d976b7e6 already deleted. [ 689.824804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61238573-5d2f-4c27-b3a7-10b2d976b7e6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.883974] env[69777]: INFO networking_nsxv3.common.synchronization [req-f0ae2e66-b6fd-4331-abdd-7efa16844334 req-dfd469f9-d3fa-47ba-bd62-461d1bf4e39c tempest-ServerDiagnosticsNegativeTest-1255524236 tempest-ServerDiagnosticsNegativeTest-1255524236-project-member] Enqueued Resource ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 with Priority: HIGHEST for action security_group_members [ 689.884540] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 with Priority: HIGHEST for action security_group_members [ 689.884850] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-112c73e9-a691-4970-a3cf-0bce8dd9a106 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.884985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.885096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.885408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.885620] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.885756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.885815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.886026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.886114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.886214] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('112c73e9-a691-4970-a3cf-0bce8dd9a106',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.167487] env[69777]: INFO networking_nsxv3.common.synchronization [None req-afc631bf-06fc-41de-b34a-29e69cec78f4 tempest-ServersTestFqdnHostnames-746215206 tempest-ServersTestFqdnHostnames-746215206-project-member] Enqueued Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_rules [ 690.168069] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_rules [ 690.168410] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.168572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.168630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.168941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.172277] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.232995] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54ece09a-8f35-4152-a654-20e3b05650f5: rpc.has_security_group_logging(os_id): False [ 690.251028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.251348] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.251348] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.251483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.251580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.251809] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.251910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.251968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.252127] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.252207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.252382] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.252475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.252542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.252766] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.252766] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.252944] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.253059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.253108] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.253491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.253491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.253491] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be updated. [ 690.309503] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.309739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.309841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.310105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.310285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.324165] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: IN_PROGRESS for 2s [ 690.330828] env[69777]: INFO networking_nsxv3.common.synchronization [req-da7a4cd4-6a1c-46f8-9144-fddf1a823240 req-5f5fd277-bcbb-42ff-bc5e-bade92026f09 service nova] Enqueued Resource ID: aa84311d-f462-487f-91c4-49b7e8315838 with Priority: HIGHEST for action security_group_rules [ 690.331857] env[69777]: INFO networking_nsxv3.common.synchronization [req-da7a4cd4-6a1c-46f8-9144-fddf1a823240 req-5f5fd277-bcbb-42ff-bc5e-bade92026f09 service nova] Enqueued Resource ID: aa84311d-f462-487f-91c4-49b7e8315838 with Priority: HIGHEST for action security_group_members [ 690.332078] env[69777]: INFO networking_nsxv3.common.synchronization [req-da7a4cd4-6a1c-46f8-9144-fddf1a823240 req-5f5fd277-bcbb-42ff-bc5e-bade92026f09 service nova] Enqueued Resource ID: 25f863e8-102c-4e54-b58f-2b8567366d95 with Priority: HIGHEST for action port [ 690.332350] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa84311d-f462-487f-91c4-49b7e8315838 with Priority: HIGHEST for action security_group_rules [ 690.332517] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa84311d-f462-487f-91c4-49b7e8315838 with Priority: HIGHEST for action security_group_members [ 690.332643] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f863e8-102c-4e54-b58f-2b8567366d95 with Priority: HIGHEST for action port [ 690.335194] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa84311d-f462-487f-91c4-49b7e8315838 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.335194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.335194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.335194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.335542] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa84311d-f462-487f-91c4-49b7e8315838',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.337061] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa84311d-f462-487f-91c4-49b7e8315838 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.337061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.337061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.337061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.337061] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.337061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.337061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.337430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.337430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.337430] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa84311d-f462-487f-91c4-49b7e8315838',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.338609] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-25f863e8-102c-4e54-b58f-2b8567366d95 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.338609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25f863e8-102c-4e54-b58f-2b8567366d95" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.338609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25f863e8-102c-4e54-b58f-2b8567366d95" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.338609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25f863e8-102c-4e54-b58f-2b8567366d95" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.338850] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25f863e8-102c-4e54-b58f-2b8567366d95',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.391681] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.392385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.393220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.393456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.393580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.393988] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.394239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.394314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.394515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.394598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.394689] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 already deleted. [ 690.395253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.442815] env[69777]: INFO networking_nsxv3.common.synchronization [None req-230a6541-7fcd-48cb-8a27-6d7bc228e96b tempest-ServersTestFqdnHostnames-746215206 tempest-ServersTestFqdnHostnames-746215206-project-member] Enqueued Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_rules [ 690.443260] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_rules [ 690.443871] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.443871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.693095] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.693246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.693317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.693537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.693626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.693717] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 already deleted. [ 690.693794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.693945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.694113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.694191] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.754233] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 690.755255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.755484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.755732] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.755931] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.756059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.756178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.756357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.756498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.756598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.757550] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.790692] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.790972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.790972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.791317] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.791552] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.792095] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.792095] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.792095] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.792370] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.792405] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.792946] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.792946] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.792946] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.793619] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.793619] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.793619] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.812165] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.812165] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 690.812367] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.812852] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.813158] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-a8b048d5-af1d-499e-a8da-9cda489c4254 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.813783] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-a8b048d5-af1d-499e-a8da-9cda489c4254" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.813783] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-a8b048d5-af1d-499e-a8da-9cda489c4254" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.813967] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-a8b048d5-af1d-499e-a8da-9cda489c4254" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.813967] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8b048d5-af1d-499e-a8da-9cda489c4254',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.841587] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa84311d-f462-487f-91c4-49b7e8315838 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.841774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.841841] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa84311d-f462-487f-91c4-49b7e8315838',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.844437] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25f863e8-102c-4e54-b58f-2b8567366d95 with status ACTIVE [ 690.844437] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.844437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.844437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.844437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.844652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.844652] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.844847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.844847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.845020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.845129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.845316] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.845436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.845475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.845666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.845700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.845767] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25f863e8-102c-4e54-b58f-2b8567366d95 is going to be updated. [ 690.866057] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.866204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.866279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.866547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.866697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.866861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25f863e8-102c-4e54-b58f-2b8567366d95" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.215303] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.215473] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.215520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.215920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.216068] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.216193] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 already deleted. [ 691.216290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.217970] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 in Status: SUCCESS [ 691.218190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.261572] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.261956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.261956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.262055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.262308] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.262403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.263980] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.263980] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.263980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.263980] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.317682] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.317923] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.318077] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.318465] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.318665] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.318829] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port a8b048d5-af1d-499e-a8da-9cda489c4254 not found, creating... [ 691.319120] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.319281] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.319400] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.319627] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.319942] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.322726] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.323753] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.323753] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.323753] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.323753] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.323753] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: a8b048d5-af1d-499e-a8da-9cda489c4254 is going to be created. [ 691.343689] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa84311d-f462-487f-91c4-49b7e8315838',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.348296] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.348577] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.348664] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.348907] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.349154] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.349371] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-a8b048d5-af1d-499e-a8da-9cda489c4254" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.616876] env[69777]: INFO networking_nsxv3.common.synchronization [None req-249a6fa5-2f0d-4889-b7c9-e5ec15323649 None None] Enqueued Resource ID: 06e9470a-a0b3-460a-8a70-f286d2478b2d with Priority: HIGHEST for action port [ 691.617196] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e9470a-a0b3-460a-8a70-f286d2478b2d with Priority: HIGHEST for action port [ 691.617886] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-06e9470a-a0b3-460a-8a70-f286d2478b2d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.617977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06e9470a-a0b3-460a-8a70-f286d2478b2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.617977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06e9470a-a0b3-460a-8a70-f286d2478b2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.619594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06e9470a-a0b3-460a-8a70-f286d2478b2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.619737] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06e9470a-a0b3-460a-8a70-f286d2478b2d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.766738] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c31a3d66-3f9b-4509-bdc2-763f23333743: rpc.has_security_group_logging(os_id): False [ 691.785501] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.785700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.785782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.785984] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.786095] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.786317] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.786424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.786507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.786673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.786752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.786930] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.787037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.787101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.787258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.787336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.787511] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.787605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.787666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.787806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.787880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.787966] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be created. [ 691.848529] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.848765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.848864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.849069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.849323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.852693] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.852693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.852693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.854109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.857022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.857022] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa84311d-f462-487f-91c4-49b7e8315838 is going to be created. [ 691.868067] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 691.897286] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.897499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.897571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.897796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.897960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.911534] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa84311d-f462-487f-91c4-49b7e8315838 in Status: UNINITIALIZED for 2s [ 692.085923] env[69777]: INFO networking_nsxv3.common.synchronization [req-4027139e-b1c7-4bb2-80d8-8655b5953131 req-5f0fdb0d-680b-44c8-a9ba-d2974216e05b tempest-ImagesNegativeTestJSON-1415695133 tempest-ImagesNegativeTestJSON-1415695133-project-member] Enqueued Resource ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 with Priority: HIGHEST for action security_group_members [ 692.086574] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 with Priority: HIGHEST for action security_group_members [ 692.086902] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-08af296d-bf45-410a-a0dc-29f3c9a17a13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.087038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.087105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.087313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.087469] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.087571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.087643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.087776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.087862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.087953] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08af296d-bf45-410a-a0dc-29f3c9a17a13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.122377] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06e9470a-a0b3-460a-8a70-f286d2478b2d [ 692.122671] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.122885] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.122948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.123521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.123521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.123521] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06e9470a-a0b3-460a-8a70-f286d2478b2d already deleted. [ 692.123751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06e9470a-a0b3-460a-8a70-f286d2478b2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.341205] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 692.342411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.590380] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.590642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.590770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.591118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.591278] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.591911] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.591911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.591911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.592126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.592734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.592734] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 is going to be updated. [ 692.625815] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.625982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.626060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.626609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.626609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.640349] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 in Status: IN_PROGRESS for 2s [ 693.163314] env[69777]: INFO networking_nsxv3.common.synchronization [req-f0ae2e66-b6fd-4331-abdd-7efa16844334 req-b774b287-1148-4d95-b2e6-0040d85cb63c service nova] Enqueued Resource ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 with Priority: HIGHEST for action security_group_rules [ 693.163990] env[69777]: INFO networking_nsxv3.common.synchronization [req-f0ae2e66-b6fd-4331-abdd-7efa16844334 req-b774b287-1148-4d95-b2e6-0040d85cb63c service nova] Enqueued Resource ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 with Priority: HIGHEST for action security_group_members [ 693.163990] env[69777]: INFO networking_nsxv3.common.synchronization [req-f0ae2e66-b6fd-4331-abdd-7efa16844334 req-b774b287-1148-4d95-b2e6-0040d85cb63c service nova] Enqueued Resource ID: a8b048d5-af1d-499e-a8da-9cda489c4254 with Priority: HIGHEST for action port [ 693.166221] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 with Priority: HIGHEST for action security_group_rules [ 693.166221] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 with Priority: HIGHEST for action security_group_members [ 693.166221] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8b048d5-af1d-499e-a8da-9cda489c4254 with Priority: HIGHEST for action port [ 693.166221] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-112c73e9-a691-4970-a3cf-0bce8dd9a106 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.166221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.166221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.167600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.168863] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('112c73e9-a691-4970-a3cf-0bce8dd9a106',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.173107] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-112c73e9-a691-4970-a3cf-0bce8dd9a106 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.173107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.173107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.173107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.173107] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.173107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.173107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.173107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.173107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.173107] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('112c73e9-a691-4970-a3cf-0bce8dd9a106',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.174400] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8b048d5-af1d-499e-a8da-9cda489c4254 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.174658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8b048d5-af1d-499e-a8da-9cda489c4254" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.174809] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8b048d5-af1d-499e-a8da-9cda489c4254" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.175100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8b048d5-af1d-499e-a8da-9cda489c4254" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.175286] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8b048d5-af1d-499e-a8da-9cda489c4254',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.250568] env[69777]: INFO networking_nsxv3.common.synchronization [None req-b88e920f-d9f9-425a-b318-97dc46a1be97 None None] Enqueued Resource ID: 2f340dea-f28e-4646-912d-4b3c9a9a757b with Priority: HIGHEST for action port [ 693.250675] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f340dea-f28e-4646-912d-4b3c9a9a757b with Priority: HIGHEST for action port [ 693.251829] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f340dea-f28e-4646-912d-4b3c9a9a757b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.251829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f340dea-f28e-4646-912d-4b3c9a9a757b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.251829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f340dea-f28e-4646-912d-4b3c9a9a757b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.251829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f340dea-f28e-4646-912d-4b3c9a9a757b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.252295] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f340dea-f28e-4646-912d-4b3c9a9a757b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.678143] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-112c73e9-a691-4970-a3cf-0bce8dd9a106 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.678143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.678143] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('112c73e9-a691-4970-a3cf-0bce8dd9a106',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.678661] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8b048d5-af1d-499e-a8da-9cda489c4254 with status ACTIVE [ 693.678661] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.678771] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.678771] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.678771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.678771] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8b048d5-af1d-499e-a8da-9cda489c4254 is going to be updated. [ 693.702123] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.702259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.702324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.702531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.702660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.702828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8b048d5-af1d-499e-a8da-9cda489c4254" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.754517] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f340dea-f28e-4646-912d-4b3c9a9a757b [ 693.754517] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.754682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.754718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.755197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.755197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.755197] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f340dea-f28e-4646-912d-4b3c9a9a757b already deleted. [ 693.755197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f340dea-f28e-4646-912d-4b3c9a9a757b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.881577] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 693.881847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.919783] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa84311d-f462-487f-91c4-49b7e8315838 in Status: SUCCESS [ 693.919999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.920647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.921175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.921659] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.921801] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.921866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.922057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.923995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.923995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.923995] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa84311d-f462-487f-91c4-49b7e8315838',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.070646] env[69777]: INFO networking_nsxv3.common.synchronization [None req-b3613db7-b079-480e-bb47-c8ae7e968768 tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_rules [ 694.071757] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_rules [ 694.073309] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.073309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.073309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.073309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.073309] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.182801] env[69777]: INFO networking_nsxv3.common.synchronization [None req-de9fd31a-3697-4069-a325-254266f63c18 tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_rules [ 694.182801] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('112c73e9-a691-4970-a3cf-0bce8dd9a106',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.186394] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_rules [ 694.186394] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.186394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.425317] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa84311d-f462-487f-91c4-49b7e8315838 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.425317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.425317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.425317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.425317] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.425317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.425317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.425782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.425782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.425782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.425782] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa84311d-f462-487f-91c4-49b7e8315838 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.425926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.425926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.426044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.427870] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.427870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.427870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.427870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.427870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.427870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.427870] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa84311d-f462-487f-91c4-49b7e8315838',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.542351] env[69777]: INFO networking_nsxv3.common.synchronization [None req-2d1260c4-d59f-4553-9e53-4b3e11d62734 None None] Enqueued Resource ID: 10aaead3-7ca3-424a-8885-9ec641cd32d4 with Priority: HIGHEST for action port [ 694.543379] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10aaead3-7ca3-424a-8885-9ec641cd32d4 with Priority: HIGHEST for action port [ 694.543588] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-10aaead3-7ca3-424a-8885-9ec641cd32d4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.543715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10aaead3-7ca3-424a-8885-9ec641cd32d4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.543810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10aaead3-7ca3-424a-8885-9ec641cd32d4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.544215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10aaead3-7ca3-424a-8885-9ec641cd32d4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.544354] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10aaead3-7ca3-424a-8885-9ec641cd32d4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.598457] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.598457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.598457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.598457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.598457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.598457] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e already deleted. [ 694.598457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.598457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.598457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.598457] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.645687] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 in Status: SUCCESS [ 694.645953] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 deletion is rescheduled due to dependency. [ 694.646556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.691170] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.691411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.691491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.691797] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.691963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.692086] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 is going to be created. [ 694.717716] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.717937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.718283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.718385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.718631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.729360] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 in Status: UNINITIALIZED for 2s [ 694.937130] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa84311d-f462-487f-91c4-49b7e8315838: rpc.has_security_group_logging(os_id): False [ 694.955239] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.959194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.959194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.959194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.960225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.963024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.963024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.963024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.963024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.963024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.963024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.963024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.963024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.963024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.963024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.963024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.966784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.966784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.966784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.966784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.966784] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa84311d-f462-487f-91c4-49b7e8315838 is going to be created. [ 695.033091] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.033254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.033342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.033589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.033791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.046474] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa84311d-f462-487f-91c4-49b7e8315838 in Status: IN_PROGRESS for 2s [ 695.049015] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10aaead3-7ca3-424a-8885-9ec641cd32d4 [ 695.049365] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.049492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.049492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.052313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.052313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.052313] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10aaead3-7ca3-424a-8885-9ec641cd32d4 already deleted. [ 695.052313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10aaead3-7ca3-424a-8885-9ec641cd32d4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.127804] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.128966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.129094] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.129304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.129393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.129495] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e already deleted. [ 695.129600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.455106] env[69777]: INFO networking_nsxv3.common.synchronization [None req-5d440fda-fdbd-4731-b646-77f06bb25443 None None] Enqueued Resource ID: 6afe47f6-9689-41fc-99b5-a74ab62deb01 with Priority: HIGHEST for action port [ 695.455833] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6afe47f6-9689-41fc-99b5-a74ab62deb01 with Priority: HIGHEST for action port [ 695.456578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-6afe47f6-9689-41fc-99b5-a74ab62deb01 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.456578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6afe47f6-9689-41fc-99b5-a74ab62deb01" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.456578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6afe47f6-9689-41fc-99b5-a74ab62deb01" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.456854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6afe47f6-9689-41fc-99b5-a74ab62deb01" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.456854] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6afe47f6-9689-41fc-99b5-a74ab62deb01',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.959156] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6afe47f6-9689-41fc-99b5-a74ab62deb01 [ 695.960501] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.960501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.960501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.960501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.960501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.960501] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6afe47f6-9689-41fc-99b5-a74ab62deb01 already deleted. [ 695.960501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6afe47f6-9689-41fc-99b5-a74ab62deb01" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.741172] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 in Status: SUCCESS [ 696.741388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.741554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.741793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.742020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.742152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.742221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.742376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.742458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.742549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.742640] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('112c73e9-a691-4970-a3cf-0bce8dd9a106',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.061067] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa84311d-f462-487f-91c4-49b7e8315838 in Status: SUCCESS [ 697.061346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.122432] env[69777]: INFO networking_nsxv3.common.synchronization [req-9e8c862e-2636-4781-a0d7-9de7e6775017 req-91b5b389-7ca7-44b2-9ce4-ac52dd071093 tempest-ServersWithSpecificFlavorTestJSON-1722080042 tempest-ServersWithSpecificFlavorTestJSON-1722080042-project-member] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 697.123907] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 697.125338] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.125685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.125794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.126359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.126610] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.126737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.126800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.126974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.127070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.127166] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.246449] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-112c73e9-a691-4970-a3cf-0bce8dd9a106 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.246638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.246709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.246941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.247116] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.247252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.247289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.247447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.247523] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.247610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.247758] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-112c73e9-a691-4970-a3cf-0bce8dd9a106 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.247862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.247897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.248068] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.249680] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.249680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.249680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.249680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.249680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.249680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.249680] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('112c73e9-a691-4970-a3cf-0bce8dd9a106',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.531944] env[69777]: INFO networking_nsxv3.common.synchronization [None req-37976fe7-a67c-48d0-87d4-e4888c3fcd44 tempest-ServersV294TestFqdnHostnames-207069780 tempest-ServersV294TestFqdnHostnames-207069780-project-member] Enqueued Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_rules [ 697.532506] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_rules [ 697.532815] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af922b11-ba63-48cf-97cd-b04487c3e7f1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.532934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.533021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.534360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.534610] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.616988] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.616988] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-14" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.616988] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-14" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.617148] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-14" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.617848] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.617848] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.617848] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.618177] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.618177] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.618241] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.618328] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.618433] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.618537] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.618642] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.618747] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.618871] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.633043] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.633116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.633234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.634271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.634271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.634271] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.634271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.634271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.634271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.634271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.634271] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 already deleted. [ 697.634271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.638968] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.639127] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 697.639266] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.639439] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-14" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.639727] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-481dac92-6952-4897-925e-5ba453b48a2d taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.639889] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-481dac92-6952-4897-925e-5ba453b48a2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.640015] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-481dac92-6952-4897-925e-5ba453b48a2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.640369] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-481dac92-6952-4897-925e-5ba453b48a2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.640632] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('481dac92-6952-4897-925e-5ba453b48a2d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.645755] env[69777]: INFO networking_nsxv3.common.synchronization [None req-b0e27c9b-371e-4117-843d-22a5469a4ce7 tempest-ServersV294TestFqdnHostnames-207069780 tempest-ServersV294TestFqdnHostnames-207069780-project-member] Enqueued Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_rules [ 697.646021] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_rules [ 697.647956] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af922b11-ba63-48cf-97cd-b04487c3e7f1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.647956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.752618] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 112c73e9-a691-4970-a3cf-0bce8dd9a106: rpc.has_security_group_logging(os_id): False [ 697.771733] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.771733] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.771733] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.771733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.772522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.772522] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.772522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.772522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.772522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.772522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.772522] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 is going to be created. [ 697.843963] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.843963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.843963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.843963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.843963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.853480] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 in Status: IN_PROGRESS for 2s [ 697.903073] env[69777]: INFO networking_nsxv3.common.synchronization [None req-20f8a87c-caaa-415f-a75c-abd973bb7f5a None None] Enqueued Resource ID: d7ffb2ea-6373-4c70-a8b2-5e2cd1ddec8a with Priority: HIGHEST for action port [ 697.903410] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ffb2ea-6373-4c70-a8b2-5e2cd1ddec8a with Priority: HIGHEST for action port [ 697.904718] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7ffb2ea-6373-4c70-a8b2-5e2cd1ddec8a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.904718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7ffb2ea-6373-4c70-a8b2-5e2cd1ddec8a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.904718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7ffb2ea-6373-4c70-a8b2-5e2cd1ddec8a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.906164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7ffb2ea-6373-4c70-a8b2-5e2cd1ddec8a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.906164] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7ffb2ea-6373-4c70-a8b2-5e2cd1ddec8a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.058019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.058019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.058019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.058019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.058019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.058019] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 already deleted. [ 698.058019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.058019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.058019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.058019] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.146618] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.146618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.146618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.146618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.146618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.146618] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 481dac92-6952-4897-925e-5ba453b48a2d not found, creating... [ 698.146618] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.146618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.146618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.146618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.146618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.147981] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.147981] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.147981] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.147981] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.147981] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.147981] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 481dac92-6952-4897-925e-5ba453b48a2d is going to be created. [ 698.166474] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.166680] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.166812] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.167155] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.167395] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.167654] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-481dac92-6952-4897-925e-5ba453b48a2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.407393] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7ffb2ea-6373-4c70-a8b2-5e2cd1ddec8a [ 698.407722] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.407907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.408014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.408306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.408433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.408563] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7ffb2ea-6373-4c70-a8b2-5e2cd1ddec8a already deleted. [ 698.408674] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7ffb2ea-6373-4c70-a8b2-5e2cd1ddec8a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.587283] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.587283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.587283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.587283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.587283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.587283] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 already deleted. [ 698.587283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.067141] env[69777]: INFO networking_nsxv3.common.synchronization [req-9e8c862e-2636-4781-a0d7-9de7e6775017 req-af98cc0e-7253-45c4-8088-0313a7ee41e3 service nova] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_rules [ 699.067361] env[69777]: INFO networking_nsxv3.common.synchronization [req-9e8c862e-2636-4781-a0d7-9de7e6775017 req-af98cc0e-7253-45c4-8088-0313a7ee41e3 service nova] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 699.067555] env[69777]: INFO networking_nsxv3.common.synchronization [req-9e8c862e-2636-4781-a0d7-9de7e6775017 req-af98cc0e-7253-45c4-8088-0313a7ee41e3 service nova] Enqueued Resource ID: 481dac92-6952-4897-925e-5ba453b48a2d with Priority: HIGHEST for action port [ 699.068291] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_rules [ 699.068363] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 699.068429] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 481dac92-6952-4897-925e-5ba453b48a2d with Priority: HIGHEST for action port [ 699.068830] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.068926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.069029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.069282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.069368] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.071531] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.071704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.071798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.072454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.072767] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.072868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.072868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.073304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.076945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.076945] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.076945] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-481dac92-6952-4897-925e-5ba453b48a2d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.076945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-481dac92-6952-4897-925e-5ba453b48a2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.076945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-481dac92-6952-4897-925e-5ba453b48a2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.076945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-481dac92-6952-4897-925e-5ba453b48a2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.076945] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('481dac92-6952-4897-925e-5ba453b48a2d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.578172] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.578465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.582198] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.583293] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 481dac92-6952-4897-925e-5ba453b48a2d with status ACTIVE [ 699.583504] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.583628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.583710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.584028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.584028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.584161] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.584260] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.584460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.584518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.584564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.584742] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.584832] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.584891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.585422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.585580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.585616] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 481dac92-6952-4897-925e-5ba453b48a2d is going to be updated. [ 699.621713] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.622328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.622328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.622328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.622796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.622796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-481dac92-6952-4897-925e-5ba453b48a2d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.869169] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 in Status: SUCCESS [ 699.870992] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.089151] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.592377] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.593027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.593305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.595673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.595673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.595673] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 is going to be created. [ 700.622883] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.623099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.623194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.623502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.623866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.637976] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: UNINITIALIZED for 2s [ 702.650492] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: SUCCESS [ 702.650766] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.650876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.651580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.651580] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.651580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.651580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.652071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.652071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.652071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.652071] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.802421] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab7c0731-68ea-4bcb-a3dc-058d18394def req-a460001c-9f21-4128-8ff2-3dce573f1a8c tempest-ListImageFiltersTestJSON-2080667869 tempest-ListImageFiltersTestJSON-2080667869-project-member] Enqueued Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 702.802972] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 702.803290] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.803404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.803468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.803706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.803852] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.803948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.804024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.804167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.804241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.804330] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.157211] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.259174] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.259174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.259174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.260519] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.260980] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.261613] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.261936] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.262353] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.262888] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.263668] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.263668] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.263668] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.264035] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.264246] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.264432] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.264589] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.285982] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.285982] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 703.286279] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.286544] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.289762] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-97dcf8c1-8d22-4abf-9055-2e849b4384b8 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.289762] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-97dcf8c1-8d22-4abf-9055-2e849b4384b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.289762] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-97dcf8c1-8d22-4abf-9055-2e849b4384b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.289762] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-97dcf8c1-8d22-4abf-9055-2e849b4384b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.289762] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97dcf8c1-8d22-4abf-9055-2e849b4384b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.307357] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.307357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.307357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.307357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.307559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.307586] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.307679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.307745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.307900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.307992] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.308096] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 already deleted. [ 703.308180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.660423] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a1bf12c-bf27-489b-97e0-b447bcaa1329: rpc.has_security_group_logging(os_id): False [ 703.696613] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.696808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.696883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.697114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.697205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.697461] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.697597] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.697685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.697851] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.697933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.698036] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 is going to be created. [ 703.769763] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.769948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.769977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.770254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.770387] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.780040] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: IN_PROGRESS for 2s [ 703.793896] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.793896] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.793896] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.793896] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.793896] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.793896] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 97dcf8c1-8d22-4abf-9055-2e849b4384b8 not found, creating... [ 703.793896] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.793896] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.793896] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.794231] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.794231] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.794490] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.794643] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.794754] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.794956] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.795766] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.796025] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 97dcf8c1-8d22-4abf-9055-2e849b4384b8 is going to be created. [ 703.815419] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.815555] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.815685] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.815967] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.816207] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.816421] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-97dcf8c1-8d22-4abf-9055-2e849b4384b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.047322] env[69777]: INFO networking_nsxv3.common.synchronization [req-3f2b8af1-d69b-4739-a240-0611d3ca4834 req-f35fc89a-494d-4b4e-91b8-36dbb4990ad0 tempest-ServerDiagnosticsTest-1558728588 tempest-ServerDiagnosticsTest-1558728588-project-member] Enqueued Resource ID: aa84311d-f462-487f-91c4-49b7e8315838 with Priority: HIGHEST for action security_group_members [ 704.047322] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa84311d-f462-487f-91c4-49b7e8315838 with Priority: HIGHEST for action security_group_members [ 704.047616] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa84311d-f462-487f-91c4-49b7e8315838 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.047771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.047843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.048045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.048219] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.048323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.048386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.048531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.048618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.048708] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa84311d-f462-487f-91c4-49b7e8315838',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.551458] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.551623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.551700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.551931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.552049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.552248] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.552345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.552408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.552563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.552641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.552727] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa84311d-f462-487f-91c4-49b7e8315838 is going to be updated. [ 704.581550] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.581809] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.581809] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.582125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.582276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.593926] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa84311d-f462-487f-91c4-49b7e8315838 in Status: IN_PROGRESS for 2s [ 704.697805] env[69777]: INFO networking_nsxv3.common.synchronization [None req-78e3d9b7-c229-4993-899d-bf4c18d79077 None None] Enqueued Resource ID: 77c825ce-292e-49b7-8c9b-fe085078a695 with Priority: HIGHEST for action port [ 704.698093] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77c825ce-292e-49b7-8c9b-fe085078a695 with Priority: HIGHEST for action port [ 704.698632] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-77c825ce-292e-49b7-8c9b-fe085078a695 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.698756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77c825ce-292e-49b7-8c9b-fe085078a695" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.698839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77c825ce-292e-49b7-8c9b-fe085078a695" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.699925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77c825ce-292e-49b7-8c9b-fe085078a695" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.700077] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77c825ce-292e-49b7-8c9b-fe085078a695',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.866097] env[69777]: INFO networking_nsxv3.common.synchronization [req-31aa0ac3-e536-4747-b62e-6ff2d8916ef9 req-73364ed2-2341-4615-931d-c93ab9dd2df7 tempest-ServerDiagnosticsNegativeTest-1255524236 tempest-ServerDiagnosticsNegativeTest-1255524236-project-member] Enqueued Resource ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 with Priority: HIGHEST for action security_group_members [ 704.866670] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 with Priority: HIGHEST for action security_group_members [ 704.866985] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-112c73e9-a691-4970-a3cf-0bce8dd9a106 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.867120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.867174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.867379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.867552] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.867664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.867717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.868108] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.868108] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.868773] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('112c73e9-a691-4970-a3cf-0bce8dd9a106',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.205574] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77c825ce-292e-49b7-8c9b-fe085078a695 [ 705.205614] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.205736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.205804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.206033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.206117] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.206345] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77c825ce-292e-49b7-8c9b-fe085078a695 already deleted. [ 705.206345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77c825ce-292e-49b7-8c9b-fe085078a695" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.342033] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab7c0731-68ea-4bcb-a3dc-058d18394def req-23616cad-8812-4608-9340-6e15e9229712 service nova] Enqueued Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_rules [ 705.342033] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab7c0731-68ea-4bcb-a3dc-058d18394def req-23616cad-8812-4608-9340-6e15e9229712 service nova] Enqueued Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 705.342033] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab7c0731-68ea-4bcb-a3dc-058d18394def req-23616cad-8812-4608-9340-6e15e9229712 service nova] Enqueued Resource ID: 97dcf8c1-8d22-4abf-9055-2e849b4384b8 with Priority: HIGHEST for action port [ 705.342033] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_rules [ 705.342033] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 705.342033] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97dcf8c1-8d22-4abf-9055-2e849b4384b8 with Priority: HIGHEST for action port [ 705.342033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.342033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.342033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.342033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.342033] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.343327] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.346316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.346316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.346316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.346316] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.348977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.348977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.348977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.348977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.348977] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.349285] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-97dcf8c1-8d22-4abf-9055-2e849b4384b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.349396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97dcf8c1-8d22-4abf-9055-2e849b4384b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.349459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97dcf8c1-8d22-4abf-9055-2e849b4384b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.349623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97dcf8c1-8d22-4abf-9055-2e849b4384b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.349697] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97dcf8c1-8d22-4abf-9055-2e849b4384b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.370944] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.371973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.372091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.372344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.372460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.372695] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.373242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.373242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.373242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.373242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.373242] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 is going to be updated. [ 705.401977] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.404337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.404337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.404337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.404337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.411532] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 in Status: IN_PROGRESS for 2s [ 705.711523] env[69777]: INFO networking_nsxv3.common.synchronization [None req-9967375e-df9f-4406-9649-26527c3c51b3 None None] Enqueued Resource ID: cc1c82ad-29cf-4471-8373-6314ae90701d with Priority: HIGHEST for action port [ 705.712060] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1c82ad-29cf-4471-8373-6314ae90701d with Priority: HIGHEST for action port [ 705.712963] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc1c82ad-29cf-4471-8373-6314ae90701d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.712963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc1c82ad-29cf-4471-8373-6314ae90701d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.712963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc1c82ad-29cf-4471-8373-6314ae90701d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.712963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc1c82ad-29cf-4471-8373-6314ae90701d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.712963] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc1c82ad-29cf-4471-8373-6314ae90701d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.793878] env[69777]: INFO networking_nsxv3.common.synchronization [req-69f5e840-3e30-45f7-869b-26b835894930 req-538a86ae-51b1-4f31-96e2-79626dd101ee tempest-ListImageFiltersTestJSON-2080667869 tempest-ListImageFiltersTestJSON-2080667869-project-member] Enqueued Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 705.795055] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: SUCCESS [ 705.795055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.795321] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 705.795637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.796238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.853266] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.853394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.853574] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.855279] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97dcf8c1-8d22-4abf-9055-2e849b4384b8 with status ACTIVE [ 705.855279] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.855279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.855279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.855279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.855279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.855621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.855621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.856361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.856361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.856361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.856742] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.856742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.856742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.857503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.857633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.857692] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97dcf8c1-8d22-4abf-9055-2e849b4384b8 is going to be updated. [ 705.878297] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.878522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.878658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.879087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.879087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.879305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97dcf8c1-8d22-4abf-9055-2e849b4384b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.216663] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc1c82ad-29cf-4471-8373-6314ae90701d [ 706.216784] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.218114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.218183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.218428] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.218488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.218656] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc1c82ad-29cf-4471-8373-6314ae90701d already deleted. [ 706.218656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc1c82ad-29cf-4471-8373-6314ae90701d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.360668] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.608032] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa84311d-f462-487f-91c4-49b7e8315838 in Status: SUCCESS [ 706.608032] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa84311d-f462-487f-91c4-49b7e8315838 deletion is rescheduled due to dependency. [ 706.608032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa84311d-f462-487f-91c4-49b7e8315838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.766614] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.766934] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.766934] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.768641] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.769409] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.769731] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.769969] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.770912] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.771536] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.771805] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.772850] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.772850] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.772850] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.772850] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.772850] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.772850] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.796729] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.796981] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 706.797136] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.797364] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.797712] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-a29f335b-f5ff-4898-9467-799c54e35d76 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.797914] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-a29f335b-f5ff-4898-9467-799c54e35d76" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.798096] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-a29f335b-f5ff-4898-9467-799c54e35d76" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.798949] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-a29f335b-f5ff-4898-9467-799c54e35d76" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.798949] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a29f335b-f5ff-4898-9467-799c54e35d76',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.866841] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.867182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.867182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.867283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.869075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.869075] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 is going to be created. [ 706.891018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.891018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.891018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.891018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.891018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.899575] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: UNINITIALIZED for 2s [ 707.248915] env[69777]: INFO networking_nsxv3.common.synchronization [None req-4518f8c4-82f1-47b6-bb6e-f8af5a577c4e tempest-ServersTestBootFromVolume-1880680884 tempest-ServersTestBootFromVolume-1880680884-project-member] Enqueued Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_rules [ 707.249411] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_rules [ 707.249719] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47227221-8e24-429f-b3e4-917bd42f6a48 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.249847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.249917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.252820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.252820] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47227221-8e24-429f-b3e4-917bd42f6a48',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.302996] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.302996] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.302996] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.303378] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.303457] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.303579] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port a29f335b-f5ff-4898-9467-799c54e35d76 not found, creating... [ 707.304106] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.304106] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.304106] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.307097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.307097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.307097] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.307097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.307097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.307097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.307097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.307097] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: a29f335b-f5ff-4898-9467-799c54e35d76 is going to be created. [ 707.332357] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.332637] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.332637] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.334522] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.334522] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.334522] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-a29f335b-f5ff-4898-9467-799c54e35d76" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.363727] env[69777]: INFO networking_nsxv3.common.synchronization [None req-6f10ce29-2387-42dc-a8d5-10416fec12b3 tempest-ServersTestBootFromVolume-1880680884 tempest-ServersTestBootFromVolume-1880680884-project-member] Enqueued Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_rules [ 707.364273] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_rules [ 707.364661] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47227221-8e24-429f-b3e4-917bd42f6a48 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.364661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.424743] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 in Status: SUCCESS [ 707.424942] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 deletion is rescheduled due to dependency. [ 707.425072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.459447] env[69777]: INFO networking_nsxv3.common.synchronization [None req-fa7d6052-d796-4408-976e-9302b59a04d5 None None] Enqueued Resource ID: 111a876c-88a8-4786-ab92-493b6bc17cc8 with Priority: HIGHEST for action port [ 707.460014] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 111a876c-88a8-4786-ab92-493b6bc17cc8 with Priority: HIGHEST for action port [ 707.460322] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-111a876c-88a8-4786-ab92-493b6bc17cc8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.460456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-111a876c-88a8-4786-ab92-493b6bc17cc8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.460523] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-111a876c-88a8-4786-ab92-493b6bc17cc8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.460767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-111a876c-88a8-4786-ab92-493b6bc17cc8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.460844] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('111a876c-88a8-4786-ab92-493b6bc17cc8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.777067] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.777067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.777067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.777067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.777067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.777067] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47227221-8e24-429f-b3e4-917bd42f6a48 already deleted. [ 707.777067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.777067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.777067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.777067] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47227221-8e24-429f-b3e4-917bd42f6a48',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.810929] env[69777]: INFO networking_nsxv3.common.synchronization [None req-57afc794-fa41-4514-b3f6-01b89fd6fd96 None None] Enqueued Resource ID: b3d2dca8-2e00-4352-9cd5-c379a6491295 with Priority: HIGHEST for action port [ 707.810929] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3d2dca8-2e00-4352-9cd5-c379a6491295 with Priority: HIGHEST for action port [ 707.810929] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3d2dca8-2e00-4352-9cd5-c379a6491295 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.811450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3d2dca8-2e00-4352-9cd5-c379a6491295" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.811619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3d2dca8-2e00-4352-9cd5-c379a6491295" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.811929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3d2dca8-2e00-4352-9cd5-c379a6491295" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.812307] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3d2dca8-2e00-4352-9cd5-c379a6491295',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.964436] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 111a876c-88a8-4786-ab92-493b6bc17cc8 [ 707.964906] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.965106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.965232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.965506] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.965622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.965781] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:111a876c-88a8-4786-ab92-493b6bc17cc8 already deleted. [ 707.965884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-111a876c-88a8-4786-ab92-493b6bc17cc8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.219707] env[69777]: INFO networking_nsxv3.common.synchronization [req-69f5e840-3e30-45f7-869b-26b835894930 req-f598f209-ec4c-46f2-9391-3a23b4bcfbe0 service nova] Enqueued Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_rules [ 708.219707] env[69777]: INFO networking_nsxv3.common.synchronization [req-69f5e840-3e30-45f7-869b-26b835894930 req-f598f209-ec4c-46f2-9391-3a23b4bcfbe0 service nova] Enqueued Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 708.219707] env[69777]: INFO networking_nsxv3.common.synchronization [req-69f5e840-3e30-45f7-869b-26b835894930 req-f598f209-ec4c-46f2-9391-3a23b4bcfbe0 service nova] Enqueued Resource ID: a29f335b-f5ff-4898-9467-799c54e35d76 with Priority: HIGHEST for action port [ 708.219707] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_rules [ 708.219707] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 708.223212] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29f335b-f5ff-4898-9467-799c54e35d76 with Priority: HIGHEST for action port [ 708.223212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.223212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.223212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.223212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.225772] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a29f335b-f5ff-4898-9467-799c54e35d76 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.225772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a29f335b-f5ff-4898-9467-799c54e35d76" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.225772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a29f335b-f5ff-4898-9467-799c54e35d76" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.225961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a29f335b-f5ff-4898-9467-799c54e35d76" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.225961] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a29f335b-f5ff-4898-9467-799c54e35d76',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.296758] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.296902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.296975] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.297466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.297569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.297714] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47227221-8e24-429f-b3e4-917bd42f6a48 already deleted. [ 708.297756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.315253] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3d2dca8-2e00-4352-9cd5-c379a6491295 [ 708.315253] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.315253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.315429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.315858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.316173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.316173] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3d2dca8-2e00-4352-9cd5-c379a6491295 already deleted. [ 708.316504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3d2dca8-2e00-4352-9cd5-c379a6491295" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.730032] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a29f335b-f5ff-4898-9467-799c54e35d76 with status ACTIVE [ 708.730032] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.730032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.730032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.730032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.730032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.730032] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.730032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.730032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.730573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.730573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.730573] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.730573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.730573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.730710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.730710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.730785] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a29f335b-f5ff-4898-9467-799c54e35d76 is going to be updated. [ 708.756824] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.756824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.756824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.756824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.756824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.757126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a29f335b-f5ff-4898-9467-799c54e35d76" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.909325] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: SUCCESS [ 708.912020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.912020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.912020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.912020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.912020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.912020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.912020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.912020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.912020] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.422226] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.925137] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.133827] env[69777]: INFO networking_nsxv3.common.synchronization [None req-74916ce9-0337-46e2-958f-a4b1c1f5234b None None] Enqueued Resource ID: b286f1ef-eefe-4386-9d5c-9e26169e7161 with Priority: HIGHEST for action port [ 710.134112] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b286f1ef-eefe-4386-9d5c-9e26169e7161 with Priority: HIGHEST for action port [ 710.134801] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b286f1ef-eefe-4386-9d5c-9e26169e7161 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.134932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b286f1ef-eefe-4386-9d5c-9e26169e7161" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.134995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b286f1ef-eefe-4386-9d5c-9e26169e7161" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.138718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b286f1ef-eefe-4386-9d5c-9e26169e7161" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.138793] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b286f1ef-eefe-4386-9d5c-9e26169e7161',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.435102] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.435102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.435102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.435102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.435102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.435102] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 is going to be updated. [ 710.461454] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.461615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.461726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.461892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.462049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.474046] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: IN_PROGRESS for 2s [ 710.644862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b286f1ef-eefe-4386-9d5c-9e26169e7161 [ 710.645128] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.645270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.646909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.646909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.646909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.646909] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b286f1ef-eefe-4386-9d5c-9e26169e7161 already deleted. [ 710.646909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b286f1ef-eefe-4386-9d5c-9e26169e7161" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.063532] env[69777]: INFO networking_nsxv3.common.synchronization [None req-072c5698-b8f7-4cf8-8af9-0ed3e8c068bb None None] Enqueued Resource ID: dd52f166-1de5-4acd-828d-a599feef8b40 with Priority: HIGHEST for action port [ 712.063532] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd52f166-1de5-4acd-828d-a599feef8b40 with Priority: HIGHEST for action port [ 712.063799] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd52f166-1de5-4acd-828d-a599feef8b40 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.063897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd52f166-1de5-4acd-828d-a599feef8b40" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.063961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd52f166-1de5-4acd-828d-a599feef8b40" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.064317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd52f166-1de5-4acd-828d-a599feef8b40" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.064395] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd52f166-1de5-4acd-828d-a599feef8b40',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.487258] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: SUCCESS [ 712.487258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.487258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.487258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.487258] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.487258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.487258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.487258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.487258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.487258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.487258] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.488584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.490334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.493952] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.493952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.493952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.493952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.493952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.493952] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.569031] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd52f166-1de5-4acd-828d-a599feef8b40 [ 712.569031] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.569031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.569031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.569031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.569031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.569031] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd52f166-1de5-4acd-828d-a599feef8b40 already deleted. [ 712.569031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd52f166-1de5-4acd-828d-a599feef8b40" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.993467] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.993467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.993788] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.227609] env[69777]: INFO networking_nsxv3.common.synchronization [None req-fba8822d-0999-4107-93e4-fc0b44daca05 None None] Enqueued Resource ID: 468cd2fd-b4cd-4e1a-9619-f2f3120c3733 with Priority: HIGHEST for action port [ 713.227967] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468cd2fd-b4cd-4e1a-9619-f2f3120c3733 with Priority: HIGHEST for action port [ 713.228499] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-468cd2fd-b4cd-4e1a-9619-f2f3120c3733 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.228617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-468cd2fd-b4cd-4e1a-9619-f2f3120c3733" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.228677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-468cd2fd-b4cd-4e1a-9619-f2f3120c3733" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.229677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-468cd2fd-b4cd-4e1a-9619-f2f3120c3733" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.229677] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('468cd2fd-b4cd-4e1a-9619-f2f3120c3733',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.496381] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.734555] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 468cd2fd-b4cd-4e1a-9619-f2f3120c3733 [ 713.734695] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.734839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.734888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.735231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.735231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.735322] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:468cd2fd-b4cd-4e1a-9619-f2f3120c3733 already deleted. [ 713.735708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-468cd2fd-b4cd-4e1a-9619-f2f3120c3733" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.005175] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.005430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.005535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.005769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.005862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.005965] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 is going to be updated. [ 714.032464] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.032625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.032694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.032909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.033219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.043946] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: IN_PROGRESS for 2s [ 715.537132] env[69777]: INFO networking_nsxv3.common.synchronization [req-fe1130eb-9994-4d57-8f00-3aa8fd796f04 req-d9705989-2007-4506-8aea-70d37871f91e tempest-ServersAdminNegativeTestJSON-1845497165 tempest-ServersAdminNegativeTestJSON-1845497165-project-member] Enqueued Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 715.537817] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 715.538377] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.538546] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.538638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.539566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.539933] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.540650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.540730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.540935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.542184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.542434] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.930973] env[69777]: INFO networking_nsxv3.common.synchronization [None req-8c6ccad4-ea8e-4cc5-945d-a6a14980b0f5 None None] Enqueued Resource ID: 25f9186b-f7d2-47b5-bcd5-59d5ea64aa26 with Priority: HIGHEST for action port [ 715.931587] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f9186b-f7d2-47b5-bcd5-59d5ea64aa26 with Priority: HIGHEST for action port [ 715.931982] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-25f9186b-f7d2-47b5-bcd5-59d5ea64aa26 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.934260] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25f9186b-f7d2-47b5-bcd5-59d5ea64aa26" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.934339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25f9186b-f7d2-47b5-bcd5-59d5ea64aa26" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.934693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25f9186b-f7d2-47b5-bcd5-59d5ea64aa26" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.934794] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25f9186b-f7d2-47b5-bcd5-59d5ea64aa26',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.988986] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.989224] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.989360] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.990274] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.990274] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.990676] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.990808] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.991106] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.991196] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.991402] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.991515] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.991624] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.991731] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.991836] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.995021] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.995021] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.018029] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.018029] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 716.018029] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.018029] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.018029] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-9768baee-a05c-4600-8421-f89ac834815a taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.018029] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-9768baee-a05c-4600-8421-f89ac834815a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.018029] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-9768baee-a05c-4600-8421-f89ac834815a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.018029] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-9768baee-a05c-4600-8421-f89ac834815a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.018029] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9768baee-a05c-4600-8421-f89ac834815a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.048540] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.048851] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.049381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.049443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.049630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.050475] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.050694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.050834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.051158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.051339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.051529] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 already deleted. [ 716.051707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.054726] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: SUCCESS [ 716.054726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.054726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.054917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.055198] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.055383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.055493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.055779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.055876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.060563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.060563] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.060563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.060563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.060563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.060563] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.060563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.060563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.060563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.060563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.060563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.065822] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.439513] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25f9186b-f7d2-47b5-bcd5-59d5ea64aa26 [ 716.440210] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.440476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.440626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.440954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.441169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.441307] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25f9186b-f7d2-47b5-bcd5-59d5ea64aa26 already deleted. [ 716.441394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25f9186b-f7d2-47b5-bcd5-59d5ea64aa26" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.480520] env[69777]: INFO networking_nsxv3.common.synchronization [None req-01f7e6a0-4453-40df-9b8c-74483cdccb27 None None] Enqueued Resource ID: 9bcc9958-8597-48cb-810e-9ac7b3638f82 with Priority: HIGHEST for action port [ 716.482550] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bcc9958-8597-48cb-810e-9ac7b3638f82 with Priority: HIGHEST for action port [ 716.482994] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bcc9958-8597-48cb-810e-9ac7b3638f82 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.483176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bcc9958-8597-48cb-810e-9ac7b3638f82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.483270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bcc9958-8597-48cb-810e-9ac7b3638f82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.483603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bcc9958-8597-48cb-810e-9ac7b3638f82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.483720] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bcc9958-8597-48cb-810e-9ac7b3638f82',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.522461] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.522696] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.522824] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.523392] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.523575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.523726] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 9768baee-a05c-4600-8421-f89ac834815a not found, creating... [ 716.524027] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.524210] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.524328] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.524664] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.524754] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.525062] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.525291] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.525291] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.525529] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.525633] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.525834] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 9768baee-a05c-4600-8421-f89ac834815a is going to be created. [ 716.548694] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.548694] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.548694] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.549156] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.549354] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.549595] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-9768baee-a05c-4600-8421-f89ac834815a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.567262] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21a326fc-9e4a-40d9-978f-e62a7f187043: rpc.has_security_group_logging(os_id): False [ 716.599546] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.599686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.599686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.601212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.601212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.601212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.601212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.601212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.601212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.601212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.601212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.601212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.601212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.601212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.601212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.604036] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.604036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.604036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.604036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.604036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.604036] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 is going to be created. [ 716.752880] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.753259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.753259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.753349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.757021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.770110] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: IN_PROGRESS for 2s [ 716.774816] env[69777]: INFO networking_nsxv3.common.synchronization [None req-25039e63-1f1b-47c3-a755-ef05d2275491 None None] Enqueued Resource ID: f9034eec-4617-4e5f-99b1-269dfab71d66 with Priority: HIGHEST for action port [ 716.779580] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9034eec-4617-4e5f-99b1-269dfab71d66 with Priority: HIGHEST for action port [ 716.780645] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9034eec-4617-4e5f-99b1-269dfab71d66 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.782183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9034eec-4617-4e5f-99b1-269dfab71d66" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.782183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9034eec-4617-4e5f-99b1-269dfab71d66" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.782183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9034eec-4617-4e5f-99b1-269dfab71d66" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.782183] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9034eec-4617-4e5f-99b1-269dfab71d66',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.986952] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bcc9958-8597-48cb-810e-9ac7b3638f82 [ 716.987278] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.987514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.987563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.987820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.987934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.988078] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bcc9958-8597-48cb-810e-9ac7b3638f82 already deleted. [ 716.988189] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bcc9958-8597-48cb-810e-9ac7b3638f82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.285409] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9034eec-4617-4e5f-99b1-269dfab71d66 [ 717.286384] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.286384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.286384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.286384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.286384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.286384] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9034eec-4617-4e5f-99b1-269dfab71d66 already deleted. [ 717.286384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9034eec-4617-4e5f-99b1-269dfab71d66" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.392669] env[69777]: INFO networking_nsxv3.common.synchronization [req-fe1130eb-9994-4d57-8f00-3aa8fd796f04 req-1718a002-6c0a-405f-b672-d452ab874149 service nova] Enqueued Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_rules [ 717.398119] env[69777]: INFO networking_nsxv3.common.synchronization [req-fe1130eb-9994-4d57-8f00-3aa8fd796f04 req-1718a002-6c0a-405f-b672-d452ab874149 service nova] Enqueued Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 717.398119] env[69777]: INFO networking_nsxv3.common.synchronization [req-fe1130eb-9994-4d57-8f00-3aa8fd796f04 req-1718a002-6c0a-405f-b672-d452ab874149 service nova] Enqueued Resource ID: 9768baee-a05c-4600-8421-f89ac834815a with Priority: HIGHEST for action port [ 717.400266] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_rules [ 717.400266] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 717.400266] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9768baee-a05c-4600-8421-f89ac834815a with Priority: HIGHEST for action port [ 717.400266] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.400266] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.400445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.400652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.400737] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.401733] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.401854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.401939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.402141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.402325] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.402478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.402579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.402791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.402867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.402961] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.404297] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9768baee-a05c-4600-8421-f89ac834815a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.404297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9768baee-a05c-4600-8421-f89ac834815a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.404297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9768baee-a05c-4600-8421-f89ac834815a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.404297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9768baee-a05c-4600-8421-f89ac834815a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.404297] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9768baee-a05c-4600-8421-f89ac834815a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.906270] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.907343] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.907451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.907609] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9768baee-a05c-4600-8421-f89ac834815a with status ACTIVE [ 717.907790] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.907901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.908514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.908514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.908514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.908514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.908514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.908858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.908858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.908858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.908938] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.910133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.910244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.910624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.910624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.910716] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9768baee-a05c-4600-8421-f89ac834815a is going to be updated. [ 717.933486] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.933486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.933486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.933486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.933486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.933486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9768baee-a05c-4600-8421-f89ac834815a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.159453] env[69777]: INFO networking_nsxv3.common.synchronization [req-669a8847-155a-4f74-931a-f01de66b8dd0 req-d6596062-3e94-4db3-aff4-a1042f7c1018 tempest-InstanceActionsTestJSON-421978891 tempest-InstanceActionsTestJSON-421978891-project-member] Enqueued Resource ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 with Priority: HIGHEST for action security_group_members [ 718.160025] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 with Priority: HIGHEST for action security_group_members [ 718.160329] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.160454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.160522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.160763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.160927] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.161350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.161438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.161670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.161709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.161878] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf4c6ca-ca7e-4a65-b871-10c3163bd739',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.416227] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.665519] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.665679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.665795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.666129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.666129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.666281] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.666531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.666531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.666657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.666696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.666817] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 already deleted. [ 718.666870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.780997] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: SUCCESS [ 718.781381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.781553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.781770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.781858] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.797587] env[69777]: INFO networking_nsxv3.common.synchronization [req-7b92cbfe-588c-4b7e-a83e-dfde1129e333 req-af5d7c08-87e3-4299-b77d-ec0ecd3e4157 tempest-ListServerFiltersTestJSON-475682025 tempest-ListServerFiltersTestJSON-475682025-project-member] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 718.798056] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 718.798376] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.798503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.798569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.798760] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.798925] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.799031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.799093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.799470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.799470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.799470] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.847123] env[69777]: INFO networking_nsxv3.common.synchronization [None req-db9dcdd9-7e79-432c-b8f5-d04c57ef3a78 None None] Enqueued Resource ID: fcbbb59a-07c4-4482-ac60-ae401ad6da1c with Priority: HIGHEST for action port [ 718.847123] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcbbb59a-07c4-4482-ac60-ae401ad6da1c with Priority: HIGHEST for action port [ 718.847975] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcbbb59a-07c4-4482-ac60-ae401ad6da1c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.848121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcbbb59a-07c4-4482-ac60-ae401ad6da1c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.848301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcbbb59a-07c4-4482-ac60-ae401ad6da1c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.848660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcbbb59a-07c4-4482-ac60-ae401ad6da1c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.848746] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcbbb59a-07c4-4482-ac60-ae401ad6da1c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.919840] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.919840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.919840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.920200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.920200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.920200] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 is going to be created. [ 718.944404] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.944562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.945865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.945865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.947551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.953423] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.954387] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-537" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.954581] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-537" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.955034] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-537" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.955580] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.955713] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.955875] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.956186] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.956649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.956649] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.956649] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.956885] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.957084] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.957279] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.957405] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.957535] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.961370] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: UNINITIALIZED for 2s [ 718.973365] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.973556] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 718.973719] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.974219] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-537" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.974296] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-fb25bdd6-8dd4-47e9-ab17-e64d264d5909 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.974608] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-fb25bdd6-8dd4-47e9-ab17-e64d264d5909" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.974608] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-fb25bdd6-8dd4-47e9-ab17-e64d264d5909" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.974925] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-fb25bdd6-8dd4-47e9-ab17-e64d264d5909" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.975100] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb25bdd6-8dd4-47e9-ab17-e64d264d5909',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.285942] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a6faf84b-978f-42f7-895d-361a0eb06b72 None None] Enqueued Resource ID: 5917991f-4070-4818-a374-277db6d3db7c with Priority: HIGHEST for action port [ 719.286225] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5917991f-4070-4818-a374-277db6d3db7c with Priority: HIGHEST for action port [ 719.286874] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.287681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.287681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.287681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.287681] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.287681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.287681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.288034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.288034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.288034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.288034] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.288872] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-5917991f-4070-4818-a374-277db6d3db7c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.289014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5917991f-4070-4818-a374-277db6d3db7c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.289105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5917991f-4070-4818-a374-277db6d3db7c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.289313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5917991f-4070-4818-a374-277db6d3db7c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.289394] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5917991f-4070-4818-a374-277db6d3db7c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.304833] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.353375] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fcbbb59a-07c4-4482-ac60-ae401ad6da1c [ 719.353597] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.353725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.353794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.354021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.355330] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.355442] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fcbbb59a-07c4-4482-ac60-ae401ad6da1c already deleted. [ 719.355531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcbbb59a-07c4-4482-ac60-ae401ad6da1c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.428967] env[69777]: INFO networking_nsxv3.common.synchronization [None req-aa7494bf-54c2-4ad5-9e2e-0ea0d86254a2 tempest-VolumesAdminNegativeTest-1280332786 tempest-VolumesAdminNegativeTest-1280332786-project-member] Enqueued Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_rules [ 719.430112] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_rules [ 719.430112] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df000c73-dfce-4f6a-a3af-75deec8fae28 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.430112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.430112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.430112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.430549] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.478331] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.478552] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.478706] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.478986] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.480616] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.480616] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port fb25bdd6-8dd4-47e9-ab17-e64d264d5909 not found, creating... [ 719.480886] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.481069] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.481190] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.482205] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.482205] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.482205] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.482205] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.483407] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.483677] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.483835] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.483986] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: fb25bdd6-8dd4-47e9-ab17-e64d264d5909 is going to be created. [ 719.505684] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.505684] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.505841] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.506080] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.506307] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.506525] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-fb25bdd6-8dd4-47e9-ab17-e64d264d5909" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.563221] env[69777]: INFO networking_nsxv3.common.synchronization [None req-4de5f309-5eed-463a-804e-9cea3fda2635 tempest-VolumesAdminNegativeTest-1280332786 tempest-VolumesAdminNegativeTest-1280332786-project-member] Enqueued Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_rules [ 719.563717] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_rules [ 719.564057] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df000c73-dfce-4f6a-a3af-75deec8fae28 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.564151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.661420] env[69777]: INFO networking_nsxv3.common.synchronization [req-8bdb77be-1597-4df0-afd1-fc76649a724c req-a101cc80-9362-4039-90d2-f4ae92dd67ff tempest-ImagesTestJSON-42450789 tempest-ImagesTestJSON-42450789-project-member] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 719.663046] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 719.663350] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.665577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.665577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.665577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.665577] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.665577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.665577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.665577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.665577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.665577] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.791742] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.791742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.791742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.791963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.793033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.793033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.793033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.793277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.793427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.793550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.793799] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.793993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.794578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.794578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.794578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.794683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.794683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.795657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.795657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.795657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.795657] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.796378] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5917991f-4070-4818-a374-277db6d3db7c [ 719.796618] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.796796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.796907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.797163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.797314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.797472] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5917991f-4070-4818-a374-277db6d3db7c already deleted. [ 719.797600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5917991f-4070-4818-a374-277db6d3db7c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.806978] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.951699] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.952040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.952040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.952272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.952272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.952346] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df000c73-dfce-4f6a-a3af-75deec8fae28 already deleted. [ 719.952404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.952558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.952714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.952859] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.167875] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.167875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.167875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.167993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.168142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.168313] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.168393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.168457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.168603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.168679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.168764] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 720.197253] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.197253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.197253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.197253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.197253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.207672] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 720.280678] env[69777]: INFO networking_nsxv3.common.synchronization [req-669a8847-155a-4f74-931a-f01de66b8dd0 req-e86d5a9a-768c-4ee8-9ddc-33c937f0cb22 service nova] Enqueued Resource ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 with Priority: HIGHEST for action security_group_rules [ 720.280864] env[69777]: INFO networking_nsxv3.common.synchronization [req-669a8847-155a-4f74-931a-f01de66b8dd0 req-e86d5a9a-768c-4ee8-9ddc-33c937f0cb22 service nova] Enqueued Resource ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 with Priority: HIGHEST for action security_group_members [ 720.281010] env[69777]: INFO networking_nsxv3.common.synchronization [req-669a8847-155a-4f74-931a-f01de66b8dd0 req-e86d5a9a-768c-4ee8-9ddc-33c937f0cb22 service nova] Enqueued Resource ID: fb25bdd6-8dd4-47e9-ab17-e64d264d5909 with Priority: HIGHEST for action port [ 720.281531] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 with Priority: HIGHEST for action security_group_rules [ 720.281665] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 with Priority: HIGHEST for action security_group_members [ 720.281788] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb25bdd6-8dd4-47e9-ab17-e64d264d5909 with Priority: HIGHEST for action port [ 720.282380] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bf4c6ca-ca7e-4a65-b871-10c3163bd739 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.282569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.282679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.282964] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.283114] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bf4c6ca-ca7e-4a65-b871-10c3163bd739',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.284445] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.284650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.284804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.285091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.285396] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.285552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.285656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.285861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.286512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.286512] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf4c6ca-ca7e-4a65-b871-10c3163bd739',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.290020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb25bdd6-8dd4-47e9-ab17-e64d264d5909 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.290020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb25bdd6-8dd4-47e9-ab17-e64d264d5909" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.290020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb25bdd6-8dd4-47e9-ab17-e64d264d5909" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.290020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb25bdd6-8dd4-47e9-ab17-e64d264d5909" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.290020] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb25bdd6-8dd4-47e9-ab17-e64d264d5909',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.299177] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21a326fc-9e4a-40d9-978f-e62a7f187043: rpc.has_security_group_logging(os_id): False [ 720.309091] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.309240] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.309309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.309519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.309605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.309698] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be updated. [ 720.318062] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.318204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.318275] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.318460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.318548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.318757] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.318855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.318918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.319076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.319154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.319668] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.319668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.319668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.319668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.319854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.319908] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.320020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.320080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.320221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.320294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.320378] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 is going to be updated. [ 720.340168] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.340299] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.341042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.341042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.341042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.350698] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: IN_PROGRESS for 2s [ 720.381725] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.381897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.381954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.382159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.382300] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.394710] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: IN_PROGRESS for 2s [ 720.471740] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.471921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.471921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.472162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.472623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.472795] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df000c73-dfce-4f6a-a3af-75deec8fae28 already deleted. [ 720.472917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.785507] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.786495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.790099] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb25bdd6-8dd4-47e9-ab17-e64d264d5909 with status ACTIVE [ 720.790328] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.790468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.790563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.791231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.791231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.791231] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.791231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.791231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.791397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.791397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.791645] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.791645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.791645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.791986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.791986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.791986] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb25bdd6-8dd4-47e9-ab17-e64d264d5909 is going to be updated. [ 720.798277] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bf4c6ca-ca7e-4a65-b871-10c3163bd739',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.818259] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.818728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.818728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.818728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.818856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.819591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb25bdd6-8dd4-47e9-ab17-e64d264d5909" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.972319] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: SUCCESS [ 720.975027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.975027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.975027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.975027] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.975027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.975027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.975027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.975027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.975027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.975027] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.983268] env[69777]: INFO networking_nsxv3.common.synchronization [req-13c7e8d4-40ea-4b06-9702-43bfb6a2fa07 req-ba4d2ce9-955e-42c6-8766-ef2305f4e72f tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 720.984021] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 720.984505] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.984949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.985172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.985597] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.985951] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.986267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.986489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.987180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.988857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.988857] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.300038] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bf4c6ca-ca7e-4a65-b871-10c3163bd739',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.400089] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.402018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.402018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.402018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.402018] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.402018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.402018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.402018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.402018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.402586] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.402836] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.403135] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.403363] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.403599] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.404612] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.404939] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.422675] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.424978] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 721.424978] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.424978] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.424978] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-04363f6a-6382-4d1f-938b-eaedca50d88d taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.424978] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-04363f6a-6382-4d1f-938b-eaedca50d88d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.424978] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-04363f6a-6382-4d1f-938b-eaedca50d88d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.424978] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-04363f6a-6382-4d1f-938b-eaedca50d88d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.424978] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04363f6a-6382-4d1f-938b-eaedca50d88d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.477438] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.477661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.477661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.478047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.478348] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.478598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.478780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.479065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.479341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.479396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.479783] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.479783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.480035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.480106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.481028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.481028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.481028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.481028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.481028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.481028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.481028] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.490629] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.490787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.490837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.491211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.491211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.491389] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.491486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.491582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.491758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.491843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.491947] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 already deleted. [ 721.492049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.802943] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.802943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.802943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.802943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.803204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.803204] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 is going to be created. [ 721.826644] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.826740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.826740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.827860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.827860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.838516] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 in Status: UNINITIALIZED for 2s [ 721.927382] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.927674] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.929296] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.929296] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.929296] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.929296] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 04363f6a-6382-4d1f-938b-eaedca50d88d not found, creating... [ 721.929296] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.929296] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.929296] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.929296] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.929674] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.929795] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.929892] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.930015] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.930280] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.930449] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.930575] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 04363f6a-6382-4d1f-938b-eaedca50d88d is going to be created. [ 721.960020] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.960020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.960020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.960020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.960020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.960020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-04363f6a-6382-4d1f-938b-eaedca50d88d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.983801] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292: rpc.has_security_group_logging(os_id): False [ 722.001320] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.002562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.002562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.002562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.002562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.002562] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.002562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.002562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.003039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.003187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.003432] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.003583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.003684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.003876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.004008] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.004269] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.004431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.004535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.004761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.004893] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.005028] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 is going to be created. [ 722.088348] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.088498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.088572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.088825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.089042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.110888] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: IN_PROGRESS for 2s [ 722.223144] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 722.223144] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 deletion is rescheduled due to dependency. [ 722.223144] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.363822] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 722.364378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.410906] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: SUCCESS [ 722.410906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.935622] env[69777]: INFO networking_nsxv3.common.synchronization [req-13c7e8d4-40ea-4b06-9702-43bfb6a2fa07 req-b3f4e35a-7483-4666-9477-dadebd95a308 service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 722.935801] env[69777]: INFO networking_nsxv3.common.synchronization [req-13c7e8d4-40ea-4b06-9702-43bfb6a2fa07 req-b3f4e35a-7483-4666-9477-dadebd95a308 service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 722.935944] env[69777]: INFO networking_nsxv3.common.synchronization [req-13c7e8d4-40ea-4b06-9702-43bfb6a2fa07 req-b3f4e35a-7483-4666-9477-dadebd95a308 service nova] Enqueued Resource ID: 04363f6a-6382-4d1f-938b-eaedca50d88d with Priority: HIGHEST for action port [ 722.936189] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 722.936317] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 722.936416] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04363f6a-6382-4d1f-938b-eaedca50d88d with Priority: HIGHEST for action port [ 722.937056] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.937169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.937169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.937404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.937515] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.938380] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.938450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.938489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.939090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.939090] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.939090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.939090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.939090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.939430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.939430] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.940024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-04363f6a-6382-4d1f-938b-eaedca50d88d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.940114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04363f6a-6382-4d1f-938b-eaedca50d88d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.940413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04363f6a-6382-4d1f-938b-eaedca50d88d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.940413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04363f6a-6382-4d1f-938b-eaedca50d88d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.940413] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04363f6a-6382-4d1f-938b-eaedca50d88d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.442597] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.442866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.442950] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.445575] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04363f6a-6382-4d1f-938b-eaedca50d88d with status ACTIVE [ 723.445885] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.445973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.446030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.447040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.447040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.447040] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.447040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.447040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.447040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.447040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.447314] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.447314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.447314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.447410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.447491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.447523] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04363f6a-6382-4d1f-938b-eaedca50d88d is going to be updated. [ 723.469045] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.469045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.469045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.469045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.469045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.469316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04363f6a-6382-4d1f-938b-eaedca50d88d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.849542] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 in Status: SUCCESS [ 723.849751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.849913] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.850165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.850351] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.850472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.850530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.850695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.850773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.850947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.850947] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bf4c6ca-ca7e-4a65-b871-10c3163bd739',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.945500] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.124812] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: SUCCESS [ 724.125013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.355525] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.355694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.355768] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.356014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.356189] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.356310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.356375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.356505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.356596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.356657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.356831] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.356930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.356987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.357147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.357287] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.357379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.357435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.357573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.357647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.357731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.357821] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bf4c6ca-ca7e-4a65-b871-10c3163bd739',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.448081] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.448081] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.448081] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.448516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.448516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.448516] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be created. [ 724.517352] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.517555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.517871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.517966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.518112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.531633] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: UNINITIALIZED for 2s [ 724.865137] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bf4c6ca-ca7e-4a65-b871-10c3163bd739: rpc.has_security_group_logging(os_id): False [ 724.884526] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.884526] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.884526] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.884526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.885125] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.885271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.885362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.885551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.885659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.885980] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 is going to be created. [ 724.950973] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.950973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.950973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.950973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.950973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.962184] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 in Status: IN_PROGRESS for 2s [ 726.094230] env[69777]: INFO networking_nsxv3.common.synchronization [req-00fcc317-5c05-40ab-a477-a826395418e6 req-205b8528-2c00-44cf-ba3c-69b9631bf041 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 726.094230] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 726.094553] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.094678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.096515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.096515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.096515] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.096515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.096515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.096515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.096515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.096515] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.544070] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 726.544366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.544708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.544883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.545081] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.545231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.545310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.545493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.545596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.545718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.545808] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.599940] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.600157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.600237] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.600516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.600617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.600823] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.600929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.600992] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.601158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.601234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.601319] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 already deleted. [ 726.601402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.605057] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.605262] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.605388] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.605677] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.605937] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.609587] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.609744] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.609988] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.610199] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.610352] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.610463] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.610589] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.611370] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.611370] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.611370] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.611370] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.631281] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.631484] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 726.631653] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.631868] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.632234] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-146e3348-51de-4927-b381-253a486c9218 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.632442] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-146e3348-51de-4927-b381-253a486c9218" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.632591] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-146e3348-51de-4927-b381-253a486c9218" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.632955] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-146e3348-51de-4927-b381-253a486c9218" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.633222] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('146e3348-51de-4927-b381-253a486c9218',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.979174] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 in Status: SUCCESS [ 726.979407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.054599] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.054804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.054804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.055012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.055177] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.055278] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.055341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.055487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.055572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.055656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.055794] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.055879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.055933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.056105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.056319] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.056319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.056463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.056525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.056581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.056696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.056792] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.137387] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.137689] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.137756] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.138802] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.138802] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.138802] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 146e3348-51de-4927-b381-253a486c9218 not found, creating... [ 727.138802] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.139269] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.139269] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.140288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.140288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.140288] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.140288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.140288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.140288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.140593] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.140593] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 146e3348-51de-4927-b381-253a486c9218 is going to be created. [ 727.162587] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.163935] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.163935] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.163935] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.163935] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.163935] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-146e3348-51de-4927-b381-253a486c9218" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.559206] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06bee688-2b64-4a9b-b0eb-ee4c735a9c41: rpc.has_security_group_logging(os_id): False [ 727.581455] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.581455] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.581455] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.581455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.582287] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.582510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.582679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.582908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.583128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.583308] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be created. [ 727.639170] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.639170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.639170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.639170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.639170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.653603] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 728.232285] env[69777]: INFO networking_nsxv3.common.synchronization [req-00fcc317-5c05-40ab-a477-a826395418e6 req-b72b65b7-ee3d-4716-9ed8-06b19061af3d service nova] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_rules [ 728.232556] env[69777]: INFO networking_nsxv3.common.synchronization [req-00fcc317-5c05-40ab-a477-a826395418e6 req-b72b65b7-ee3d-4716-9ed8-06b19061af3d service nova] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 728.232591] env[69777]: INFO networking_nsxv3.common.synchronization [req-00fcc317-5c05-40ab-a477-a826395418e6 req-b72b65b7-ee3d-4716-9ed8-06b19061af3d service nova] Enqueued Resource ID: 146e3348-51de-4927-b381-253a486c9218 with Priority: HIGHEST for action port [ 728.233066] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_rules [ 728.233066] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 728.233066] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 146e3348-51de-4927-b381-253a486c9218 with Priority: HIGHEST for action port [ 728.233596] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.233724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.233910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.234062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.234583] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.235388] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.235818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.235965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.236211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.236895] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.237101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.237207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.237416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.237628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.237628] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.243075] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-146e3348-51de-4927-b381-253a486c9218 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.243075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-146e3348-51de-4927-b381-253a486c9218" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.244521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-146e3348-51de-4927-b381-253a486c9218" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.244521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-146e3348-51de-4927-b381-253a486c9218" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.244521] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('146e3348-51de-4927-b381-253a486c9218',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.648377] env[69777]: INFO networking_nsxv3.common.synchronization [None req-fc4d65ff-2ebc-43a6-9a96-b84fb3be3649 None None] Enqueued Resource ID: 79d1989c-2140-4834-a837-e6ccae3c9c9a with Priority: HIGHEST for action port [ 728.648640] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79d1989c-2140-4834-a837-e6ccae3c9c9a with Priority: HIGHEST for action port [ 728.649253] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-79d1989c-2140-4834-a837-e6ccae3c9c9a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.649393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79d1989c-2140-4834-a837-e6ccae3c9c9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.649821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79d1989c-2140-4834-a837-e6ccae3c9c9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.649821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79d1989c-2140-4834-a837-e6ccae3c9c9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.649821] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79d1989c-2140-4834-a837-e6ccae3c9c9a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.744451] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.747176] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.747176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.747176] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 146e3348-51de-4927-b381-253a486c9218 with status ACTIVE [ 728.748862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.748862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.748862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.748862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.748862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.748862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.748862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.748862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.748862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.748862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.749472] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.749676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.749676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.749931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.751126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.751126] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 146e3348-51de-4927-b381-253a486c9218 is going to be updated. [ 728.773589] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.773796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.773796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.774019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.774159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.774326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-146e3348-51de-4927-b381-253a486c9218" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.804950] env[69777]: INFO networking_nsxv3.common.synchronization [req-cf1820dc-cb52-4c12-bf57-87f58eca34a0 req-2f89800d-4993-48e8-8634-865e89ee0c14 tempest-InstanceActionsV221TestJSON-348477085 tempest-InstanceActionsV221TestJSON-348477085-project-member] Enqueued Resource ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 with Priority: HIGHEST for action security_group_members [ 728.805519] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 with Priority: HIGHEST for action security_group_members [ 728.805851] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ee1d406-4eef-4a6f-9340-fafaa839ac55 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.806012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.806754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.808062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.808326] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.808584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.808769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.808960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.809190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.809336] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ee1d406-4eef-4a6f-9340-fafaa839ac55',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.152296] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79d1989c-2140-4834-a837-e6ccae3c9c9a [ 729.152568] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.152716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.154480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.154835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.154946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.155077] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79d1989c-2140-4834-a837-e6ccae3c9c9a already deleted. [ 729.155177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79d1989c-2140-4834-a837-e6ccae3c9c9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.245447] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.246102] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-269" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.246102] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-269" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.246102] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-269" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.246306] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.246435] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.246576] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.246804] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.246943] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.247406] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.247406] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.247516] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.247571] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.247689] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.247824] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.247824] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.249668] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.267027] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.267216] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 729.267355] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.267534] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-269" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.267868] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-2f8e4f79-144c-4647-96e7-17bab1232474 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.268074] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-2f8e4f79-144c-4647-96e7-17bab1232474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.268176] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-2f8e4f79-144c-4647-96e7-17bab1232474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.268509] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-2f8e4f79-144c-4647-96e7-17bab1232474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.268973] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f8e4f79-144c-4647-96e7-17bab1232474',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.315208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.315208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.315208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.315208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.315208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.315208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.315208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.315208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.315208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.315208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.315208] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 already deleted. [ 729.315208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.666029] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 729.666029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.752724] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.752884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.752983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.753231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.753327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.753430] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 is going to be created. [ 729.771168] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.771474] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.771626] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.771911] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.772055] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.772219] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 2f8e4f79-144c-4647-96e7-17bab1232474 not found, creating... [ 729.772488] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.772649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.772803] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.772983] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.773182] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.773462] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.773585] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.773705] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.773924] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.774116] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.774265] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 2f8e4f79-144c-4647-96e7-17bab1232474 is going to be created. [ 729.777329] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.777449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.777519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.777686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.777932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.790832] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: UNINITIALIZED for 2s [ 729.800252] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.800333] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.800454] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.800775] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.801058] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.801281] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-2f8e4f79-144c-4647-96e7-17bab1232474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.093628] env[69777]: INFO networking_nsxv3.common.synchronization [req-5d7b678f-b1ec-4709-b06f-fddd7c1d7f3c req-5dc00929-e432-4c4d-a3c4-7207ed5e5f7b tempest-SecurityGroupRulesTestJSON-615168050 tempest-SecurityGroupRulesTestJSON-615168050-project-member] Enqueued Resource ID: 8f52a387-ed7a-490e-afee-6deee4596ba2 with Priority: HIGHEST for action security_group_rules [ 730.094159] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f52a387-ed7a-490e-afee-6deee4596ba2 with Priority: HIGHEST for action security_group_rules [ 730.094403] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f52a387-ed7a-490e-afee-6deee4596ba2 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.094949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f52a387-ed7a-490e-afee-6deee4596ba2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.094949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f52a387-ed7a-490e-afee-6deee4596ba2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.095065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f52a387-ed7a-490e-afee-6deee4596ba2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.095156] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f52a387-ed7a-490e-afee-6deee4596ba2',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.617478] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.618863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.618863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.618863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.618863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.618863] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f52a387-ed7a-490e-afee-6deee4596ba2 already deleted. [ 730.618863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f52a387-ed7a-490e-afee-6deee4596ba2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.733304] env[69777]: INFO networking_nsxv3.common.synchronization [req-cf1820dc-cb52-4c12-bf57-87f58eca34a0 req-d0dc1cbb-4fdd-40c3-8e60-d9c769240cdf service nova] Enqueued Resource ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 with Priority: HIGHEST for action security_group_rules [ 730.733304] env[69777]: INFO networking_nsxv3.common.synchronization [req-cf1820dc-cb52-4c12-bf57-87f58eca34a0 req-d0dc1cbb-4fdd-40c3-8e60-d9c769240cdf service nova] Enqueued Resource ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 with Priority: HIGHEST for action security_group_members [ 730.733304] env[69777]: INFO networking_nsxv3.common.synchronization [req-cf1820dc-cb52-4c12-bf57-87f58eca34a0 req-d0dc1cbb-4fdd-40c3-8e60-d9c769240cdf service nova] Enqueued Resource ID: 2f8e4f79-144c-4647-96e7-17bab1232474 with Priority: HIGHEST for action port [ 730.733304] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 with Priority: HIGHEST for action security_group_rules [ 730.733304] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 with Priority: HIGHEST for action security_group_members [ 730.733304] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8e4f79-144c-4647-96e7-17bab1232474 with Priority: HIGHEST for action port [ 730.733304] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ee1d406-4eef-4a6f-9340-fafaa839ac55 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.733304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.733304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.736448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.736448] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ee1d406-4eef-4a6f-9340-fafaa839ac55',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.737542] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ee1d406-4eef-4a6f-9340-fafaa839ac55 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.738537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.738537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.738537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.738537] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.738537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.738537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.738780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.738780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.738910] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ee1d406-4eef-4a6f-9340-fafaa839ac55',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.739975] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f8e4f79-144c-4647-96e7-17bab1232474 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.740121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f8e4f79-144c-4647-96e7-17bab1232474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.740209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f8e4f79-144c-4647-96e7-17bab1232474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.740423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f8e4f79-144c-4647-96e7-17bab1232474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.740528] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f8e4f79-144c-4647-96e7-17bab1232474',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.092076] env[69777]: INFO networking_nsxv3.common.synchronization [req-5e9de563-9fef-49c3-99ea-672894e6cb85 req-9e996c6b-a0b0-4990-9dbe-1c519adc4229 tempest-SecurityGroupRulesTestJSON-615168050 tempest-SecurityGroupRulesTestJSON-615168050-project-member] Enqueued Resource ID: 466fe062-a130-459a-b2f1-7ecfa5eeb5e8 with Priority: HIGHEST for action security_group_rules [ 731.092582] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 466fe062-a130-459a-b2f1-7ecfa5eeb5e8 with Priority: HIGHEST for action security_group_rules [ 731.092888] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-466fe062-a130-459a-b2f1-7ecfa5eeb5e8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.093019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-466fe062-a130-459a-b2f1-7ecfa5eeb5e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.094201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-466fe062-a130-459a-b2f1-7ecfa5eeb5e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.094544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-466fe062-a130-459a-b2f1-7ecfa5eeb5e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.094610] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('466fe062-a130-459a-b2f1-7ecfa5eeb5e8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.100475] env[69777]: INFO networking_nsxv3.common.synchronization [None req-2eda5bde-8a6a-4006-bec7-0124c97bd2ee None None] Enqueued Resource ID: 6ec919eb-d2a8-4a56-97e4-fd02b9ff3fb3 with Priority: HIGHEST for action port [ 731.101081] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ec919eb-d2a8-4a56-97e4-fd02b9ff3fb3 with Priority: HIGHEST for action port [ 731.104524] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ec919eb-d2a8-4a56-97e4-fd02b9ff3fb3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.104524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ec919eb-d2a8-4a56-97e4-fd02b9ff3fb3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.104524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ec919eb-d2a8-4a56-97e4-fd02b9ff3fb3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.104524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ec919eb-d2a8-4a56-97e4-fd02b9ff3fb3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.104524] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ec919eb-d2a8-4a56-97e4-fd02b9ff3fb3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.244300] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ee1d406-4eef-4a6f-9340-fafaa839ac55 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.244425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.244624] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ee1d406-4eef-4a6f-9340-fafaa839ac55',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.245784] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f8e4f79-144c-4647-96e7-17bab1232474 with status ACTIVE [ 731.245784] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.245784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.246426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.246426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.246426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.246637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.246637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.246751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.246934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.247098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.247308] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.247447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.247823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.248121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.248218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.248431] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f8e4f79-144c-4647-96e7-17bab1232474 is going to be updated. [ 731.273017] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.273017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.273017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.273017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.273017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.273017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f8e4f79-144c-4647-96e7-17bab1232474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.604202] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ec919eb-d2a8-4a56-97e4-fd02b9ff3fb3 [ 731.604427] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.604558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.604628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.604874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.604972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.605080] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ec919eb-d2a8-4a56-97e4-fd02b9ff3fb3 already deleted. [ 731.605166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ec919eb-d2a8-4a56-97e4-fd02b9ff3fb3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.617418] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.617548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.617776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.617814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.618067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.618067] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 466fe062-a130-459a-b2f1-7ecfa5eeb5e8 already deleted. [ 731.618067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-466fe062-a130-459a-b2f1-7ecfa5eeb5e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.752127] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ee1d406-4eef-4a6f-9340-fafaa839ac55',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.805356] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: SUCCESS [ 731.805568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.807677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.808545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.808545] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.808545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.808545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.808545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.808896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.808896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.808896] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.962787] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-a9d59f14-725b-4973-96d6-855dd2f85f21 tempest-ServersTestMultiNic-1821210824 tempest-ServersTestMultiNic-1821210824-project-member] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 731.963368] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 731.964081] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.964283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.964511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.964816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.965038] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.965186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.965272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.965471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.965593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.965716] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.261418] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.261418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.261418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.261418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.261418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.261418] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 is going to be created. [ 732.287222] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.287360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.287431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.288833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.288833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.300234] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 in Status: UNINITIALIZED for 2s [ 732.310855] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.429364] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-5e497ff8-e3a2-4975-8200-92a7bd4921d4 tempest-ServersTestMultiNic-1821210824 tempest-ServersTestMultiNic-1821210824-project-member] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 732.429907] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 732.430231] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.430329] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.467439] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.467609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.467954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.468072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.468151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.468369] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.468469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.468534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.468682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.468759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.468901] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 already deleted. [ 732.468941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.469082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.469268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.469454] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.469515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.469869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.469869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.469869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.469869] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.779466] env[69777]: INFO networking_nsxv3.common.synchronization [req-9f572e2a-16c1-4339-859c-851528729b4f req-bc9d0a8b-6e6a-465b-9f86-a579cee45273 tempest-SecurityGroupRulesTestJSON-615168050 tempest-SecurityGroupRulesTestJSON-615168050-project-member] Enqueued Resource ID: b3b1545c-a89c-4c2d-a013-684b6731b777 with Priority: HIGHEST for action security_group_rules [ 732.779753] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3b1545c-a89c-4c2d-a013-684b6731b777 with Priority: HIGHEST for action security_group_rules [ 732.780445] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3b1545c-a89c-4c2d-a013-684b6731b777 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.780445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3b1545c-a89c-4c2d-a013-684b6731b777" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.780445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3b1545c-a89c-4c2d-a013-684b6731b777" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.780664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3b1545c-a89c-4c2d-a013-684b6731b777" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.781241] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3b1545c-a89c-4c2d-a013-684b6731b777',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.815642] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb60d30-acd9-42ec-9942-d71d6c7c14f6: rpc.has_security_group_logging(os_id): False [ 732.843479] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-626cba09-51ed-4313-a369-ec133eea78b8 tempest-ServersTestMultiNic-1821210824 tempest-ServersTestMultiNic-1821210824-project-member] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 732.846226] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 732.846226] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.846226] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.846395] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.846647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.846707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.847242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.847470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.850906] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.850906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.850906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.850906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.850906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.850906] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 is going to be created. [ 732.933550] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.933550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.933550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.933550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.933550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.945156] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: IN_PROGRESS for 2s [ 732.973742] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.973742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.973742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.973742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.973742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.973742] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.973742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.974112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.974218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.974291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.974403] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 already deleted. [ 732.974515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.974778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.975013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.975205] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.975363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.975424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.975585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.976212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.976212] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.305363] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.305683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.305683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.305847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.305946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.306059] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3b1545c-a89c-4c2d-a013-684b6731b777 already deleted. [ 733.306148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3b1545c-a89c-4c2d-a013-684b6731b777" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.366473] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-819 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.366473] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-819" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.366473] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-819" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.366473] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-819" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.366473] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.366473] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.366473] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.366964] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.367199] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.367324] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.367485] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.367636] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.367792] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.368074] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.368328] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.368328] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.389077] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.389274] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 733.389418] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.389602] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-819" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.389915] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-8e290c4c-7785-4ef3-8d71-03fac7e00f25 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.390119] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-8e290c4c-7785-4ef3-8d71-03fac7e00f25" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.390245] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-8e290c4c-7785-4ef3-8d71-03fac7e00f25" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.390568] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-8e290c4c-7785-4ef3-8d71-03fac7e00f25" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.390712] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e290c4c-7785-4ef3-8d71-03fac7e00f25',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.481630] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.481630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.481630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.481630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.481630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.481630] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.481630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.481630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.481630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.481630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.481630] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 already deleted. [ 733.481630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.896644] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.897064] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.897064] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.897277] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.897435] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.897670] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 8e290c4c-7785-4ef3-8d71-03fac7e00f25 not found, creating... [ 733.897986] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.898168] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.898289] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.898734] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.898920] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.899266] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.899454] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.899565] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.899785] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.899920] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.900281] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 8e290c4c-7785-4ef3-8d71-03fac7e00f25 is going to be created. [ 733.919674] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.919972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.920175] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.920554] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.920870] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.921193] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-8e290c4c-7785-4ef3-8d71-03fac7e00f25" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.184888] env[69777]: INFO networking_nsxv3.common.synchronization [req-638c7338-1fb2-4072-b0eb-5624f964f746 req-727f9acd-6ba5-4b17-bba9-193d1c6da5c8 tempest-SecurityGroupRulesTestJSON-615168050 tempest-SecurityGroupRulesTestJSON-615168050-project-member] Enqueued Resource ID: c599c558-82da-4b9e-8817-5410b1a5ed08 with Priority: HIGHEST for action security_group_rules [ 734.184888] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c599c558-82da-4b9e-8817-5410b1a5ed08 with Priority: HIGHEST for action security_group_rules [ 734.185634] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c599c558-82da-4b9e-8817-5410b1a5ed08 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.188085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c599c558-82da-4b9e-8817-5410b1a5ed08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.188085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c599c558-82da-4b9e-8817-5410b1a5ed08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.188085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c599c558-82da-4b9e-8817-5410b1a5ed08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.188085] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c599c558-82da-4b9e-8817-5410b1a5ed08',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.320525] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 in Status: SUCCESS [ 734.320525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.320525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.320525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.320525] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.320525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.320525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.320525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.320821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.320821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.320821] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ee1d406-4eef-4a6f-9340-fafaa839ac55',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.470386] env[69777]: INFO networking_nsxv3.common.synchronization [req-844aac30-b398-4eba-b126-56cc27960976 req-ed48cd9f-8b16-44a6-9d51-4a5377363e81 tempest-ServersTestJSON-413471657 tempest-ServersTestJSON-413471657-project-member] Enqueued Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_members [ 734.471384] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_members [ 734.471384] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f2530c-f805-4944-9fb5-070cda7bf623 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.471526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.471526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.471786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.472631] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.472631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.472846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.473055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.473186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.473317] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.708764] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.709037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.709169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.709396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.709491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.709591] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c599c558-82da-4b9e-8817-5410b1a5ed08 already deleted. [ 734.709677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c599c558-82da-4b9e-8817-5410b1a5ed08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.826781] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ee1d406-4eef-4a6f-9340-fafaa839ac55 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.827086] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.827086] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.827326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.827504] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.827604] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.827666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.827828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.827920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.828014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.828232] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ee1d406-4eef-4a6f-9340-fafaa839ac55 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.828307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.828371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.828514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.828654] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.828746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.828807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.828947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.829044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.829136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.829223] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ee1d406-4eef-4a6f-9340-fafaa839ac55',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.965036] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: SUCCESS [ 734.965290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.974390] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-aa151abd-4ace-4b48-8c9b-d28348519f5e service nova] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_rules [ 734.974569] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-aa151abd-4ace-4b48-8c9b-d28348519f5e service nova] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 734.974796] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-aa151abd-4ace-4b48-8c9b-d28348519f5e service nova] Enqueued Resource ID: 8e290c4c-7785-4ef3-8d71-03fac7e00f25 with Priority: HIGHEST for action port [ 734.975121] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_rules [ 734.975268] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 734.975378] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e290c4c-7785-4ef3-8d71-03fac7e00f25 with Priority: HIGHEST for action port [ 734.975972] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.976388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.976460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.976657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.976747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.977231] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.977343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.977410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.977573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.977653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.977740] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f2530c-f805-4944-9fb5-070cda7bf623 already deleted. [ 734.977833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.978105] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.978206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.978269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.978640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.978743] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.981405] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.982251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.982251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.982251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.982251] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.982418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.982418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.982501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.982581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.982667] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.983641] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e290c4c-7785-4ef3-8d71-03fac7e00f25 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.984429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e290c4c-7785-4ef3-8d71-03fac7e00f25" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.984429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e290c4c-7785-4ef3-8d71-03fac7e00f25" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.984429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e290c4c-7785-4ef3-8d71-03fac7e00f25" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.984429] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e290c4c-7785-4ef3-8d71-03fac7e00f25',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.088659] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.089035] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-938" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.089226] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-938" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.089597] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-938" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.089922] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.090189] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.090375] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.090649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.090851] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.091123] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.091293] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.091463] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.091665] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.091833] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.091990] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.092193] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.111846] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.111955] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.112083] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.112255] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-938" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.112621] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-840cc226-1fd3-407d-82f5-df49811b691c taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.112724] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-840cc226-1fd3-407d-82f5-df49811b691c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.112864] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-840cc226-1fd3-407d-82f5-df49811b691c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.113194] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-840cc226-1fd3-407d-82f5-df49811b691c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.113335] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('840cc226-1fd3-407d-82f5-df49811b691c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.334863] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ee1d406-4eef-4a6f-9340-fafaa839ac55: rpc.has_security_group_logging(os_id): False [ 735.356740] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.357114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.357482] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.358308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.358308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.358308] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.358308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.358628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.359200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.359200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.359348] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.359536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.359902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.360258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.361221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.361221] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.361221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.361221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.361531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.361678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.361804] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 is going to be created. [ 735.427153] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.427239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.427343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.427522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.427716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.439309] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 in Status: IN_PROGRESS for 2s [ 735.489686] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.489686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.489686] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.489686] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e290c4c-7785-4ef3-8d71-03fac7e00f25 with status ACTIVE [ 735.489686] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.489686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.489686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.489686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.489686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.489686] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.489686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.489686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.489686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.490662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.490662] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.490820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.490914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.491120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.491235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.491373] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e290c4c-7785-4ef3-8d71-03fac7e00f25 is going to be updated. [ 735.517686] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.518158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.518158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.518340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.518504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.518671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e290c4c-7785-4ef3-8d71-03fac7e00f25" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.615975] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.616222] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.616346] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.616628] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.616772] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.617139] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 840cc226-1fd3-407d-82f5-df49811b691c not found, creating... [ 735.617445] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.617616] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.617744] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.618057] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.618225] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.618559] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.618729] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.618861] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.619114] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.619330] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.619473] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 840cc226-1fd3-407d-82f5-df49811b691c is going to be created. [ 735.647489] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.647703] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.647852] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.648161] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.648398] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.648668] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-840cc226-1fd3-407d-82f5-df49811b691c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.782472] env[69777]: INFO networking_nsxv3.common.synchronization [req-125aec84-17af-4c33-9c69-ab13fcb0f46f req-dcda01d8-4122-439b-bf76-55219579f7e6 tempest-SecurityGroupRulesTestJSON-615168050 tempest-SecurityGroupRulesTestJSON-615168050-project-member] Enqueued Resource ID: 549c3895-09e2-40fc-ba09-d2947cf85528 with Priority: HIGHEST for action security_group_rules [ 735.783026] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549c3895-09e2-40fc-ba09-d2947cf85528 with Priority: HIGHEST for action security_group_rules [ 735.783363] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-549c3895-09e2-40fc-ba09-d2947cf85528 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.783490] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.783563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.783818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.783906] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('549c3895-09e2-40fc-ba09-d2947cf85528',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.836876] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.837254] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-463" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.837254] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-463" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.837595] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-463" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.837817] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.837992] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.838236] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.838513] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.838672] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.838928] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.839097] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.839255] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.839393] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.839588] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.839681] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.839862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.864312] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.864530] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.864682] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.864910] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-463" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.865518] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-4672c57b-73a9-49ef-8167-1e2e073ac23e taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.865641] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-4672c57b-73a9-49ef-8167-1e2e073ac23e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.866479] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-4672c57b-73a9-49ef-8167-1e2e073ac23e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.866479] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-4672c57b-73a9-49ef-8167-1e2e073ac23e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.866479] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4672c57b-73a9-49ef-8167-1e2e073ac23e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.993449] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.121431] env[69777]: INFO networking_nsxv3.common.synchronization [req-6334475d-53ee-4ddd-9fd1-186ed8f1ab0d req-f17e1205-97fe-4e46-8a99-7afae63f7930 tempest-SecurityGroupRulesTestJSON-615168050 tempest-SecurityGroupRulesTestJSON-615168050-project-member] Enqueued Resource ID: 549c3895-09e2-40fc-ba09-d2947cf85528 with Priority: HIGHEST for action security_group_rules [ 736.122012] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549c3895-09e2-40fc-ba09-d2947cf85528 with Priority: HIGHEST for action security_group_rules [ 736.122319] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-549c3895-09e2-40fc-ba09-d2947cf85528 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.122407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.309107] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.309107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.309107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.309107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.309107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.309107] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 549c3895-09e2-40fc-ba09-d2947cf85528 already deleted. [ 736.309107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.309107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.309107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.309107] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('549c3895-09e2-40fc-ba09-d2947cf85528',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.369309] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.369580] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.369793] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.370064] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.370293] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.370474] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 4672c57b-73a9-49ef-8167-1e2e073ac23e not found, creating... [ 736.370919] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.370919] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.371111] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.371264] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.371405] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.371683] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.371842] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.371961] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.373933] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.375798] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.375896] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 4672c57b-73a9-49ef-8167-1e2e073ac23e is going to be created. [ 736.407794] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.408031] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.408148] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.408412] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.408639] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.408865] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-4672c57b-73a9-49ef-8167-1e2e073ac23e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.497054] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.497054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.497054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.498579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.498579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.498579] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be created. [ 736.694574] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.696267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.696347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.696577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.696739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.719188] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: UNINITIALIZED for 2s [ 736.720602] env[69777]: INFO networking_nsxv3.common.synchronization [req-16a55993-ad2e-4f51-89fc-0f7ee7bf40be req-115673cc-623a-46a1-9a1a-bdf9998d8b5e tempest-SecurityGroupRulesTestJSON-615168050 tempest-SecurityGroupRulesTestJSON-615168050-project-member] Enqueued Resource ID: 549c3895-09e2-40fc-ba09-d2947cf85528 with Priority: HIGHEST for action security_group_rules [ 736.724849] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549c3895-09e2-40fc-ba09-d2947cf85528 with Priority: HIGHEST for action security_group_rules [ 736.725445] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-549c3895-09e2-40fc-ba09-d2947cf85528 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.725557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.845486] env[69777]: INFO networking_nsxv3.common.synchronization [req-844aac30-b398-4eba-b126-56cc27960976 req-2423063f-aced-4d8c-9260-8c9d5ebd7309 service nova] Enqueued Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_rules [ 736.845663] env[69777]: INFO networking_nsxv3.common.synchronization [req-844aac30-b398-4eba-b126-56cc27960976 req-2423063f-aced-4d8c-9260-8c9d5ebd7309 service nova] Enqueued Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_members [ 736.845798] env[69777]: INFO networking_nsxv3.common.synchronization [req-844aac30-b398-4eba-b126-56cc27960976 req-2423063f-aced-4d8c-9260-8c9d5ebd7309 service nova] Enqueued Resource ID: 840cc226-1fd3-407d-82f5-df49811b691c with Priority: HIGHEST for action port [ 736.846027] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_rules [ 736.846163] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_members [ 736.846349] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 840cc226-1fd3-407d-82f5-df49811b691c with Priority: HIGHEST for action port [ 736.846875] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f2530c-f805-4944-9fb5-070cda7bf623 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.847259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.847515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.847798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.847798] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.849388] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f2530c-f805-4944-9fb5-070cda7bf623 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.850283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.850429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.850796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.850862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.851217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.851217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.851774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.851936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.852098] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.853308] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-840cc226-1fd3-407d-82f5-df49811b691c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.853482] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-840cc226-1fd3-407d-82f5-df49811b691c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.853603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-840cc226-1fd3-407d-82f5-df49811b691c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.853914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-840cc226-1fd3-407d-82f5-df49811b691c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.854052] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('840cc226-1fd3-407d-82f5-df49811b691c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.855840] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.856472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.856472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.856472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.856472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.856472] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 549c3895-09e2-40fc-ba09-d2947cf85528 already deleted. [ 736.857058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.857799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.858065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.858197] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('549c3895-09e2-40fc-ba09-d2947cf85528',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.358019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f2530c-f805-4944-9fb5-070cda7bf623 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.358406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.358406] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.359244] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 840cc226-1fd3-407d-82f5-df49811b691c with status ACTIVE [ 737.359891] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.359891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.359891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.359891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.359891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.360111] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.360111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.360180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.360324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.360402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.361028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.361028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.361028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.361028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.361028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.361028] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 840cc226-1fd3-407d-82f5-df49811b691c is going to be updated. [ 737.384216] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.384325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.384435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.384571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.384656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.384765] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 549c3895-09e2-40fc-ba09-d2947cf85528 already deleted. [ 737.384870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-549c3895-09e2-40fc-ba09-d2947cf85528" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.391335] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.391502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.391593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.391797] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.391928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.392111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-840cc226-1fd3-407d-82f5-df49811b691c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.457420] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 in Status: SUCCESS [ 737.457650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.464511] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-c71a0b4b-7fe7-4d79-8892-01b8628f2437 service nova] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_rules [ 737.464511] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-c71a0b4b-7fe7-4d79-8892-01b8628f2437 service nova] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 737.464511] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-c71a0b4b-7fe7-4d79-8892-01b8628f2437 service nova] Enqueued Resource ID: 4672c57b-73a9-49ef-8167-1e2e073ac23e with Priority: HIGHEST for action port [ 737.465025] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_rules [ 737.465710] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 737.465710] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4672c57b-73a9-49ef-8167-1e2e073ac23e with Priority: HIGHEST for action port [ 737.465847] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.465997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.466317] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.466450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.467291] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-4672c57b-73a9-49ef-8167-1e2e073ac23e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.467291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4672c57b-73a9-49ef-8167-1e2e073ac23e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.467291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4672c57b-73a9-49ef-8167-1e2e073ac23e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.467291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4672c57b-73a9-49ef-8167-1e2e073ac23e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.467544] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4672c57b-73a9-49ef-8167-1e2e073ac23e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.581424] env[69777]: INFO networking_nsxv3.common.synchronization [req-7d9f93ed-9db8-44b7-b167-2af07fed82f1 req-68a11b32-e889-4311-8b9b-41f1b28b31a3 tempest-InstanceActionsTestJSON-421978891 tempest-InstanceActionsTestJSON-421978891-project-member] Enqueued Resource ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 with Priority: HIGHEST for action security_group_members [ 737.583764] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 with Priority: HIGHEST for action security_group_members [ 737.583764] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.583910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.583910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.584069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.584202] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.584298] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.584357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.584511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.584591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.584690] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf4c6ca-ca7e-4a65-b871-10c3163bd739',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.864815] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.970247] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4672c57b-73a9-49ef-8167-1e2e073ac23e with status ACTIVE [ 737.970509] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.970619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.970688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.970915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.971032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.971192] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.971299] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.971380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.971523] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.971599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.971778] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.971939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.971939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.972203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.972203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.972291] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4672c57b-73a9-49ef-8167-1e2e073ac23e is going to be updated. [ 738.022712] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.022852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.022906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.023175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.023323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.023486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4672c57b-73a9-49ef-8167-1e2e073ac23e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.089552] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.089552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.089552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.090193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.090193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.090299] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.090359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.090643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.090643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.090643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.090773] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 is going to be updated. [ 738.153709] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.153850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.153918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.154193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.154342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.169765] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 in Status: IN_PROGRESS for 2s [ 738.366299] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.366630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.366630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.366736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.366821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.367017] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f2530c-f805-4944-9fb5-070cda7bf623 is going to be created. [ 738.394107] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.394301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.395087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.395398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.396026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.405057] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-819 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.405273] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-819" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.405407] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-819" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.405691] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-819" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.405975] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.406166] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.406289] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.406552] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.406704] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.407017] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.407179] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.407305] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.407497] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.407565] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.407638] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.407778] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.409505] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f2530c-f805-4944-9fb5-070cda7bf623 in Status: UNINITIALIZED for 2s [ 738.429791] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.430076] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.430175] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.430546] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-819" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.431333] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-3bbfe78e-bd0f-41da-ad6a-71da14b83e64 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.431333] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-3bbfe78e-bd0f-41da-ad6a-71da14b83e64" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.431333] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-3bbfe78e-bd0f-41da-ad6a-71da14b83e64" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.431516] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-3bbfe78e-bd0f-41da-ad6a-71da14b83e64" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.431804] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bbfe78e-bd0f-41da-ad6a-71da14b83e64',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.738344] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 738.738451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.738693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.739017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.739830] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.740252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.740252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.740433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.740586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.740730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.740898] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.742418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.742672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.742930] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.743134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.743241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.743460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.743589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.743728] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.939510] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.939510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.939510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.939510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.939510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.939510] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 3bbfe78e-bd0f-41da-ad6a-71da14b83e64 not found, creating... [ 738.939510] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.939510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.939510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.939510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.939510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.941626] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.941929] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.942187] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.943317] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.943576] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.943852] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 3bbfe78e-bd0f-41da-ad6a-71da14b83e64 is going to be created. [ 738.969649] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.969649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.969649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.969649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.969649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.969649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-3bbfe78e-bd0f-41da-ad6a-71da14b83e64" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.246198] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.246333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.246532] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.452141] env[69777]: INFO networking_nsxv3.common.synchronization [None req-56749aea-ffa7-4030-a607-b2cfc18686b8 None None] Enqueued Resource ID: f306f81b-8a0e-4fcb-847f-f8e13cab209c with Priority: HIGHEST for action port [ 739.452576] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f306f81b-8a0e-4fcb-847f-f8e13cab209c with Priority: HIGHEST for action port [ 739.452870] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f306f81b-8a0e-4fcb-847f-f8e13cab209c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.452984] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f306f81b-8a0e-4fcb-847f-f8e13cab209c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.453242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f306f81b-8a0e-4fcb-847f-f8e13cab209c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.453565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f306f81b-8a0e-4fcb-847f-f8e13cab209c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.453698] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f306f81b-8a0e-4fcb-847f-f8e13cab209c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.748857] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.957502] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f306f81b-8a0e-4fcb-847f-f8e13cab209c [ 739.957502] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.957502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.957502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.957502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.957502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.957502] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f306f81b-8a0e-4fcb-847f-f8e13cab209c already deleted. [ 739.957502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f306f81b-8a0e-4fcb-847f-f8e13cab209c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.034113] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-caa120a9-eb11-4100-b419-7ce80f8189a4 service nova] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_rules [ 740.034113] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-caa120a9-eb11-4100-b419-7ce80f8189a4 service nova] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 740.034113] env[69777]: INFO networking_nsxv3.common.synchronization [req-d7d3677c-2b6e-48c1-956e-b3233f0500c7 req-caa120a9-eb11-4100-b419-7ce80f8189a4 service nova] Enqueued Resource ID: 3bbfe78e-bd0f-41da-ad6a-71da14b83e64 with Priority: HIGHEST for action port [ 740.034113] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_rules [ 740.034113] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 740.034113] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbfe78e-bd0f-41da-ad6a-71da14b83e64 with Priority: HIGHEST for action port [ 740.034706] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.035138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.036099] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.036345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.036669] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bbfe78e-bd0f-41da-ad6a-71da14b83e64 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.038301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bbfe78e-bd0f-41da-ad6a-71da14b83e64" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.038301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bbfe78e-bd0f-41da-ad6a-71da14b83e64" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.038301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bbfe78e-bd0f-41da-ad6a-71da14b83e64" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.038301] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bbfe78e-bd0f-41da-ad6a-71da14b83e64',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.183898] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 in Status: SUCCESS [ 740.184161] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 deletion is rescheduled due to dependency. [ 740.184231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.252348] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.252502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.252572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.252807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.252893] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.252993] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 740.288147] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.288147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.288147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.288147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.288147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.294678] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 740.423069] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f2530c-f805-4944-9fb5-070cda7bf623 in Status: SUCCESS [ 740.423308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.423475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.423731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.427283] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.427396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.427434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.427646] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.427708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.427888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.427888] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.542745] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bbfe78e-bd0f-41da-ad6a-71da14b83e64 with status ACTIVE [ 740.543106] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.543176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.543214] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.543433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.543532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.543778] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.543910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.543979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.544173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.544257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.544442] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.544538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.544603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.544747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.544824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.544908] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bbfe78e-bd0f-41da-ad6a-71da14b83e64 is going to be updated. [ 740.571170] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.571310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.571383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.571607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.571734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.571888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bbfe78e-bd0f-41da-ad6a-71da14b83e64" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.934439] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.369923] env[69777]: INFO networking_nsxv3.common.synchronization [None req-c312de06-133f-419a-b4a4-3c529f07eb49 None None] Enqueued Resource ID: e401a459-2869-4ce5-9baa-b149437ca236 with Priority: HIGHEST for action port [ 741.370199] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e401a459-2869-4ce5-9baa-b149437ca236 with Priority: HIGHEST for action port [ 741.370797] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-e401a459-2869-4ce5-9baa-b149437ca236 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.370926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e401a459-2869-4ce5-9baa-b149437ca236" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.370926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e401a459-2869-4ce5-9baa-b149437ca236" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.371445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e401a459-2869-4ce5-9baa-b149437ca236" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.371445] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e401a459-2869-4ce5-9baa-b149437ca236',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.438097] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76f2530c-f805-4944-9fb5-070cda7bf623: rpc.has_security_group_logging(os_id): False [ 741.469467] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.469828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.469979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.470376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.473158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.473158] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.473158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.473158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.473442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.473442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.473502] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f2530c-f805-4944-9fb5-070cda7bf623 is going to be created. [ 741.555489] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.556025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.556025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.556025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.556199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.566963] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76f2530c-f805-4944-9fb5-070cda7bf623 in Status: IN_PROGRESS for 2s [ 741.765541] env[69777]: INFO networking_nsxv3.common.synchronization [req-c0c595f3-ddf3-4a4e-a871-eb7bcd58bf0c req-d127d6e2-d1b6-44d7-831a-09d74eb853b4 tempest-ServersAdminTestJSON-1100102510 tempest-ServersAdminTestJSON-1100102510-project-member] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 741.766264] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 741.766525] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.767089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.767089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.767089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.767199] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.767251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.767317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.767476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.767580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.767668] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.878735] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e401a459-2869-4ce5-9baa-b149437ca236 [ 741.878875] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.878942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.879073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.881872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.881872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.881872] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e401a459-2869-4ce5-9baa-b149437ca236 already deleted. [ 741.881872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e401a459-2869-4ce5-9baa-b149437ca236" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.271768] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.305496] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 742.305741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.310564] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.310564] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.310564] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.310564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.311530] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.311530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.311530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.311530] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.311530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.311530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.311530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.311530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.311530] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.637217] env[69777]: INFO networking_nsxv3.common.synchronization [None req-dc9eab49-25ee-4ca3-af94-d8f8ec9abc1b None None] Enqueued Resource ID: f002611e-3104-44d6-b773-929779fd1193 with Priority: HIGHEST for action port [ 742.637217] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f002611e-3104-44d6-b773-929779fd1193 with Priority: HIGHEST for action port [ 742.641291] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f002611e-3104-44d6-b773-929779fd1193 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.641969] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f002611e-3104-44d6-b773-929779fd1193" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.641969] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f002611e-3104-44d6-b773-929779fd1193" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.641969] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f002611e-3104-44d6-b773-929779fd1193" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.641969] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f002611e-3104-44d6-b773-929779fd1193',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.775139] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.806313] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.806313] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.806313] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.806313] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.806313] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.806749] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.807045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.807402] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.807678] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.808031] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.808279] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.808524] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.808770] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.809037] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.810039] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.810039] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.813031] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32fe634d-ef8d-4778-9848-21e31e366d13: rpc.has_security_group_logging(os_id): False [ 742.816048] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.843243] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.843243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.843243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.843243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.843243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.843243] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.843243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.843243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.843621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.843621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.843621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.843713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.843741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.843868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.843949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.844134] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.844224] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.844281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.844416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.844504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.844723] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be created. [ 742.848051] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.848436] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.848436] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.848545] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.848837] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-2fc27917-b791-4242-b49b-bc1ce9ddacc3 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.849024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-2fc27917-b791-4242-b49b-bc1ce9ddacc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.849155] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-2fc27917-b791-4242-b49b-bc1ce9ddacc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.849418] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-2fc27917-b791-4242-b49b-bc1ce9ddacc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.852861] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fc27917-b791-4242-b49b-bc1ce9ddacc3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.918861] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.918861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.919124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.919124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.919553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.937031] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 743.144412] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f002611e-3104-44d6-b773-929779fd1193 [ 743.144932] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.144932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.144932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.145246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.145246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.145246] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f002611e-3104-44d6-b773-929779fd1193 already deleted. [ 743.145325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f002611e-3104-44d6-b773-929779fd1193" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.277598] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.277780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.277874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.278133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.278254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.278370] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 743.307295] env[69777]: INFO networking_nsxv3.common.synchronization [req-c450f584-2bf2-46d7-86d3-5d2cf8f95f52 req-b7e6f556-168a-4dac-8d3c-d4e462817862 tempest-InstanceActionsV221TestJSON-348477085 tempest-InstanceActionsV221TestJSON-348477085-project-member] Enqueued Resource ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 with Priority: HIGHEST for action security_group_members [ 743.309336] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 with Priority: HIGHEST for action security_group_members [ 743.309705] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ee1d406-4eef-4a6f-9340-fafaa839ac55 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.309868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.309967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.310262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.310462] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.310595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.310686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.310866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.310986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.311157] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ee1d406-4eef-4a6f-9340-fafaa839ac55',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.317405] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.317528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.317582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.317836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.318028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.323243] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.333036] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 743.356253] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.356592] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.356661] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.356992] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.357349] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.357961] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 2fc27917-b791-4242-b49b-bc1ce9ddacc3 not found, creating... [ 743.357961] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.357961] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.358150] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.358311] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.358453] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.358745] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.360027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.360027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.360027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.360027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.360027] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 2fc27917-b791-4242-b49b-bc1ce9ddacc3 is going to be created. [ 743.385353] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.385731] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.385731] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.385955] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.386204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.386423] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-2fc27917-b791-4242-b49b-bc1ce9ddacc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.584245] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76f2530c-f805-4944-9fb5-070cda7bf623 in Status: SUCCESS [ 743.584519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.813717] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.814296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.814296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.814296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.814296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.814458] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.814537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.814595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.814736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.814825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.814953] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 is going to be updated. [ 743.825943] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.826178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.826282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.826534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.826626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.826782] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 743.855590] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.855747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.855815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.856282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.856775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.870704] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 in Status: IN_PROGRESS for 2s [ 743.873348] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.873638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.873705] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.873914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.874094] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.882271] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 744.156480] env[69777]: INFO networking_nsxv3.common.synchronization [req-c0c595f3-ddf3-4a4e-a871-eb7bcd58bf0c req-c9fce9f2-02b1-4a7f-ad0d-076a19110905 service nova] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_rules [ 744.157872] env[69777]: INFO networking_nsxv3.common.synchronization [req-c0c595f3-ddf3-4a4e-a871-eb7bcd58bf0c req-c9fce9f2-02b1-4a7f-ad0d-076a19110905 service nova] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 744.157872] env[69777]: INFO networking_nsxv3.common.synchronization [req-c0c595f3-ddf3-4a4e-a871-eb7bcd58bf0c req-c9fce9f2-02b1-4a7f-ad0d-076a19110905 service nova] Enqueued Resource ID: 2fc27917-b791-4242-b49b-bc1ce9ddacc3 with Priority: HIGHEST for action port [ 744.158170] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_rules [ 744.160034] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 744.160034] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc27917-b791-4242-b49b-bc1ce9ddacc3 with Priority: HIGHEST for action port [ 744.160034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.160034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.160034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.160034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.160034] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.161024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.161149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.161352] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fc27917-b791-4242-b49b-bc1ce9ddacc3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.161458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fc27917-b791-4242-b49b-bc1ce9ddacc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.161533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fc27917-b791-4242-b49b-bc1ce9ddacc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.161743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fc27917-b791-4242-b49b-bc1ce9ddacc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.161822] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fc27917-b791-4242-b49b-bc1ce9ddacc3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.519302] env[69777]: INFO networking_nsxv3.common.synchronization [None req-edeaefb9-11de-4c32-a44c-40cb6c954f3d None None] Enqueued Resource ID: ed25cdf4-8c51-47e9-94cd-7325be56d460 with Priority: HIGHEST for action port [ 744.520019] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed25cdf4-8c51-47e9-94cd-7325be56d460 with Priority: HIGHEST for action port [ 744.520537] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed25cdf4-8c51-47e9-94cd-7325be56d460 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.520683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed25cdf4-8c51-47e9-94cd-7325be56d460" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.520763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed25cdf4-8c51-47e9-94cd-7325be56d460" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.521111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed25cdf4-8c51-47e9-94cd-7325be56d460" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.521174] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed25cdf4-8c51-47e9-94cd-7325be56d460',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.664117] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.664256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.664517] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fc27917-b791-4242-b49b-bc1ce9ddacc3 with status ACTIVE [ 744.664628] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.664732] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.665592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.665592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.665592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.665592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.665592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.665592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.665592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.665926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.665926] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.665926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.666070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.666100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.666474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.666474] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fc27917-b791-4242-b49b-bc1ce9ddacc3 is going to be updated. [ 744.698037] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.698037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.698037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.698037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.698037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.698037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fc27917-b791-4242-b49b-bc1ce9ddacc3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.958033] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 744.958311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.958490] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.958749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.958860] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.023733] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed25cdf4-8c51-47e9-94cd-7325be56d460 [ 745.024233] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.024233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.024384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.025584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.025584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.025584] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed25cdf4-8c51-47e9-94cd-7325be56d460 already deleted. [ 745.025584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed25cdf4-8c51-47e9-94cd-7325be56d460" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.343046] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 745.343046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.343046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.343046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.343046] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.343046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.343046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.343405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.343405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.343405] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.464709] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.464709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.847744] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.880906] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 in Status: SUCCESS [ 745.881192] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ee1d406-4eef-4a6f-9340-fafaa839ac55 deletion is rescheduled due to dependency. [ 745.882097] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ee1d406-4eef-4a6f-9340-fafaa839ac55" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.889954] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 745.890288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.890369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.890577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.890764] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.890940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.890940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.891116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.891244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.891292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.891420] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.351689] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.393807] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.393972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.394043] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.394609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.394609] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.394609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.394609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.394842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.394842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.394929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.395084] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.395187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.395248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.395395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.395536] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.395625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.395684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.395820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.395898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.395977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.396083] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.855377] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.856713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.856713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.856713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.856713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.856713] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 746.890170] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.890954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.890954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.890954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.891098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.899219] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32fe634d-ef8d-4778-9848-21e31e366d13: rpc.has_security_group_logging(os_id): False [ 746.902424] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 746.920123] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.920123] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.920123] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.920381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.920381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.920490] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.920859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.920859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.920859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.920859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.921084] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.921132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.921181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.921311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.921414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.921560] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.921749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.921749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.921827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.921899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.921989] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 746.999218] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.999451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.999522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.999730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.999876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.016130] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 748.139312] env[69777]: INFO networking_nsxv3.common.synchronization [None req-bb6e71e3-601a-4f47-95f7-5ad791238033 tempest-MigrationsAdminTest-640993244 tempest-MigrationsAdminTest-640993244-project-member] Enqueued Resource ID: 65818c57-4c50-4f6d-9099-c136106ab986 with Priority: HIGHEST for action security_group_rules [ 748.139703] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65818c57-4c50-4f6d-9099-c136106ab986 with Priority: HIGHEST for action security_group_rules [ 748.140250] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65818c57-4c50-4f6d-9099-c136106ab986 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.140412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65818c57-4c50-4f6d-9099-c136106ab986" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.140505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65818c57-4c50-4f6d-9099-c136106ab986" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.140763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65818c57-4c50-4f6d-9099-c136106ab986" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.140885] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65818c57-4c50-4f6d-9099-c136106ab986',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.260672] env[69777]: INFO networking_nsxv3.common.synchronization [None req-b585db86-f096-4e8e-bfa4-2c63af584a48 tempest-MigrationsAdminTest-640993244 tempest-MigrationsAdminTest-640993244-project-member] Enqueued Resource ID: 65818c57-4c50-4f6d-9099-c136106ab986 with Priority: HIGHEST for action security_group_rules [ 748.260831] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65818c57-4c50-4f6d-9099-c136106ab986 with Priority: HIGHEST for action security_group_rules [ 748.261270] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65818c57-4c50-4f6d-9099-c136106ab986 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.261431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65818c57-4c50-4f6d-9099-c136106ab986" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.659810] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.659985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.660037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.660342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.660609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.660689] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65818c57-4c50-4f6d-9099-c136106ab986 already deleted. [ 748.660819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65818c57-4c50-4f6d-9099-c136106ab986" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.661039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65818c57-4c50-4f6d-9099-c136106ab986" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.661242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65818c57-4c50-4f6d-9099-c136106ab986" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.661362] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65818c57-4c50-4f6d-9099-c136106ab986',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.911756] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 748.911995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.912239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.912409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.912603] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.912722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.912790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.912939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.913053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.913184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.913296] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.032645] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 749.032645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.032645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.032645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.032645] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.184375] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.184701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.184701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.185240] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.185240] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.185240] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65818c57-4c50-4f6d-9099-c136106ab986 already deleted. [ 749.185240] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65818c57-4c50-4f6d-9099-c136106ab986" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.419385] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.419554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.419629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.419840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.420016] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.420122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.420189] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.420335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.420437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.420529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.420688] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.420778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.420854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.420997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.421148] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.421253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.421309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.421429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.421505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.421652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.421717] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.534629] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.534629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.534629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.534629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.534897] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.534897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.534897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.535923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.535923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.535923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.535923] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.927141] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e: rpc.has_security_group_logging(os_id): False [ 749.949382] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.949382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.949382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.949382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.949382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.949382] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.949382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.949382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.949382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.949791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.949791] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.949791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.949884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.949965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.950091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.950251] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.950384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.950491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.950681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.950794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.950918] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 750.010048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.010209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.010281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.010929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.010929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.028975] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 750.037619] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.037770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.037835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.038078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.038291] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.038402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.038465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.038630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.038721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.038810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.038958] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.039064] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.039133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.039304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.039453] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.039570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.039644] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.039788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.039868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.039976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.040090] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.486713] env[69777]: INFO networking_nsxv3.common.synchronization [req-5e4792bf-eab9-4275-aa5d-3dfed2fe594f req-7652f9c0-7184-474e-ab1d-1f15fcef386e tempest-ServerMetadataTestJSON-1099393728 tempest-ServerMetadataTestJSON-1099393728-project-member] Enqueued Resource ID: 8a1330db-f7f7-44e4-a96f-88757581f92f with Priority: HIGHEST for action security_group_members [ 750.487566] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1330db-f7f7-44e4-a96f-88757581f92f with Priority: HIGHEST for action security_group_members [ 750.487682] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a1330db-f7f7-44e4-a96f-88757581f92f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.487776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.487818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.488223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.488400] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.488512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.488602] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.488765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.488877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.488977] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a1330db-f7f7-44e4-a96f-88757581f92f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.543135] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32fe634d-ef8d-4778-9848-21e31e366d13: rpc.has_security_group_logging(os_id): False [ 750.567250] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.567250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.567250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.567250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.567250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.567250] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.567250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.567250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.567250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.567250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.567250] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.567625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.567625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.567625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.567625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.567891] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.567891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.568078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.572341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.572474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.572597] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 750.633500] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.633500] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.633695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.633769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.633919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.647508] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 750.924930] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-784 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.925122] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-784" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.925252] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-784" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.925756] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-784" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.925830] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.925991] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.926151] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.926376] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.926557] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.926730] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.926850] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.926942] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.927086] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.927202] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.927306] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.927438] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 750.946174] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 750.946392] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 750.946480] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 750.946640] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-784" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.946940] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-5cd9f783-e269-46fa-adaa-f8f6c40fb27b taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.947189] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-5cd9f783-e269-46fa-adaa-f8f6c40fb27b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.947312] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-5cd9f783-e269-46fa-adaa-f8f6c40fb27b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.947611] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-5cd9f783-e269-46fa-adaa-f8f6c40fb27b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.947751] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cd9f783-e269-46fa-adaa-f8f6c40fb27b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.991427] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.992554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.992554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.992554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.992554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.992554] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.992554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.992554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.992554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.992554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.992554] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a1330db-f7f7-44e4-a96f-88757581f92f already deleted. [ 750.992913] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.451390] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.451631] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.451681] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.451970] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.452146] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.452307] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 5cd9f783-e269-46fa-adaa-f8f6c40fb27b not found, creating... [ 751.452569] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.452721] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.452842] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.453092] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.453224] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.453587] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.453742] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.453860] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.454084] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.454221] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.454361] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 5cd9f783-e269-46fa-adaa-f8f6c40fb27b is going to be created. [ 751.484342] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.484553] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.484726] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.484979] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.485256] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.485492] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-5cd9f783-e269-46fa-adaa-f8f6c40fb27b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.044444] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 752.044444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.240424] env[69777]: INFO networking_nsxv3.common.synchronization [req-5e4792bf-eab9-4275-aa5d-3dfed2fe594f req-bf3b7c44-47fd-4a68-9513-7f42ea0ba7ab service nova] Enqueued Resource ID: 8a1330db-f7f7-44e4-a96f-88757581f92f with Priority: HIGHEST for action security_group_rules [ 752.240602] env[69777]: INFO networking_nsxv3.common.synchronization [req-5e4792bf-eab9-4275-aa5d-3dfed2fe594f req-bf3b7c44-47fd-4a68-9513-7f42ea0ba7ab service nova] Enqueued Resource ID: 8a1330db-f7f7-44e4-a96f-88757581f92f with Priority: HIGHEST for action security_group_members [ 752.240741] env[69777]: INFO networking_nsxv3.common.synchronization [req-5e4792bf-eab9-4275-aa5d-3dfed2fe594f req-bf3b7c44-47fd-4a68-9513-7f42ea0ba7ab service nova] Enqueued Resource ID: 5cd9f783-e269-46fa-adaa-f8f6c40fb27b with Priority: HIGHEST for action port [ 752.240964] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1330db-f7f7-44e4-a96f-88757581f92f with Priority: HIGHEST for action security_group_rules [ 752.241111] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1330db-f7f7-44e4-a96f-88757581f92f with Priority: HIGHEST for action security_group_members [ 752.241214] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cd9f783-e269-46fa-adaa-f8f6c40fb27b with Priority: HIGHEST for action port [ 752.241776] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a1330db-f7f7-44e4-a96f-88757581f92f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.241922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.242076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.243113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.243272] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a1330db-f7f7-44e4-a96f-88757581f92f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.248022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a1330db-f7f7-44e4-a96f-88757581f92f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.248022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.248022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.248022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.248022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.248022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.248022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.248022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.248022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.248022] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a1330db-f7f7-44e4-a96f-88757581f92f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.248022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cd9f783-e269-46fa-adaa-f8f6c40fb27b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.248022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cd9f783-e269-46fa-adaa-f8f6c40fb27b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.248022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cd9f783-e269-46fa-adaa-f8f6c40fb27b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.248022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cd9f783-e269-46fa-adaa-f8f6c40fb27b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.248022] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cd9f783-e269-46fa-adaa-f8f6c40fb27b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.664812] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 752.665136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.745204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a1330db-f7f7-44e4-a96f-88757581f92f taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.745204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.749736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cd9f783-e269-46fa-adaa-f8f6c40fb27b with status ACTIVE [ 752.750133] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.750778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.750778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.750778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.750929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.751110] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.751222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.751319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.751570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.751703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.751965] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.752088] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.752156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.752308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.752424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.752555] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cd9f783-e269-46fa-adaa-f8f6c40fb27b is going to be updated. [ 752.753733] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a1330db-f7f7-44e4-a96f-88757581f92f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.779914] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.780071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.780138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.780349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.780508] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.781205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cd9f783-e269-46fa-adaa-f8f6c40fb27b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.256811] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a1330db-f7f7-44e4-a96f-88757581f92f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.759894] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.760094] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.760188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.760428] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.760532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.760635] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a1330db-f7f7-44e4-a96f-88757581f92f is going to be created. [ 753.788993] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.789191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.789278] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.789583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.789773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.799851] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a1330db-f7f7-44e4-a96f-88757581f92f in Status: UNINITIALIZED for 2s [ 754.147240] env[69777]: INFO networking_nsxv3.common.synchronization [req-804c545f-4793-4b09-a61f-dbe7c2631c1d req-050980e1-c513-4909-9caa-bf8b370e7408 tempest-ServersTestMultiNic-1821210824 tempest-ServersTestMultiNic-1821210824-project-member] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 754.147878] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 754.148225] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.148347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.148421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.148641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.148794] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.148895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.148957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.149139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.149225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.149336] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.403344] env[69777]: INFO networking_nsxv3.common.synchronization [req-804c545f-4793-4b09-a61f-dbe7c2631c1d req-9a1cdff6-e75c-4689-a3b1-d807008a5c04 tempest-ServersTestMultiNic-1821210824 tempest-ServersTestMultiNic-1821210824-project-member] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 754.404310] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 754.404310] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.404310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.621753] env[69777]: INFO networking_nsxv3.common.synchronization [req-804c545f-4793-4b09-a61f-dbe7c2631c1d req-8342339c-f83f-40b9-8e03-5ec6a90ebd87 tempest-ServersTestMultiNic-1821210824 tempest-ServersTestMultiNic-1821210824-project-member] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 754.621753] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 754.622501] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.622606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.653591] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.155741] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.462536] env[69777]: INFO networking_nsxv3.common.synchronization [req-e16f02e5-f824-4318-8a4c-d35b340c88d1 req-1e3ee8d4-2e7f-45ae-841c-f843a2ae34a5 tempest-ListServerFiltersTestJSON-475682025 tempest-ListServerFiltersTestJSON-475682025-project-member] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 755.463028] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 755.463342] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.463476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.463546] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.463727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.463885] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.463992] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.464734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.464977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.465089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.465229] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.681234] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.681417] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.681489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.681696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.681786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.681875] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 755.709217] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.709217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.709217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.709217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.709217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.717644] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 755.813024] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a1330db-f7f7-44e4-a96f-88757581f92f in Status: SUCCESS [ 755.813024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.813024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.813024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.813024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.813024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.813024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.813024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.813024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.813024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.813024] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a1330db-f7f7-44e4-a96f-88757581f92f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.967326] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.313789] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a1330db-f7f7-44e4-a96f-88757581f92f taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.313961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.314061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.314307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.314457] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.314557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.314615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.314761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.314850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.315087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.315288] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a1330db-f7f7-44e4-a96f-88757581f92f taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.315501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.315501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.315632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.315753] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.315839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.315901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.316052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.316143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.316204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.316323] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a1330db-f7f7-44e4-a96f-88757581f92f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.470066] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.819735] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a1330db-f7f7-44e4-a96f-88757581f92f: rpc.has_security_group_logging(os_id): False [ 756.837761] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.837983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.838174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.838504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.838658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.838950] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.839128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.839235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.839464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.839586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.839898] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.840185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.840346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.840611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.840785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.841123] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.841566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.841733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.841997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.842216] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.842395] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a1330db-f7f7-44e4-a96f-88757581f92f is going to be created. [ 756.898896] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.899073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.899152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.899429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.899622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.913727] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a1330db-f7f7-44e4-a96f-88757581f92f in Status: IN_PROGRESS for 2s [ 756.972491] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.972578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.972612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.972865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.972922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.973680] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be updated. [ 757.006689] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.006843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.007276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.007276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.007360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.016701] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: IN_PROGRESS for 2s [ 757.656494] env[69777]: INFO networking_nsxv3.common.synchronization [req-bf2f867f-c586-4957-9412-3e3b6b4a0632 req-30e90e57-8632-4f00-8124-3f20ef1fdf89 tempest-FloatingIPsAssociationNegativeTestJSON-1621898975 tempest-FloatingIPsAssociationNegativeTestJSON-1621898975-project-member] Enqueued Resource ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d with Priority: HIGHEST for action security_group_members [ 757.657018] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d with Priority: HIGHEST for action security_group_members [ 757.657942] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.658119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.658213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.658479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.658645] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.658754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.658813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.658972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.659067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.659163] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d3eb17a-d8a9-4390-bb23-b2dd83171c7d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.730381] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 757.730581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.730739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.730958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.731151] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.731270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.731339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.731489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.731572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.731662] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.017795] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.018092] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.018275] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.018765] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.019081] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.019263] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.019418] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.019681] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.019916] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.020069] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 758.020229] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.020423] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.020564] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.020671] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 758.020790] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.020974] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.041579] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.041579] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 758.041579] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.041804] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.042038] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-2af82b87-13ab-4ac1-bc0c-f716ca3f0999 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.042176] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-2af82b87-13ab-4ac1-bc0c-f716ca3f0999" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.042294] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-2af82b87-13ab-4ac1-bc0c-f716ca3f0999" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.042625] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-2af82b87-13ab-4ac1-bc0c-f716ca3f0999" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.042795] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2af82b87-13ab-4ac1-bc0c-f716ca3f0999',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.161828] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.161970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.161970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.166020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.166020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.166020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.166020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.166020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.166020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.166020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.166020] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d already deleted. [ 758.166020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.233817] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.234048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.234128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.234610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.234610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.234842] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.234889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.234919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.235084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.235159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.235789] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 758.280367] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.280367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.280367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.280367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.280665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.290834] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 758.547163] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.547163] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.547163] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.547163] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.547163] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.547163] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 2af82b87-13ab-4ac1-bc0c-f716ca3f0999 not found, creating... [ 758.547163] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.547163] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.547690] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.547690] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.547690] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.547907] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.548065] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.548200] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.548435] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.548574] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.548713] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 2af82b87-13ab-4ac1-bc0c-f716ca3f0999 is going to be created. [ 758.569967] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.570203] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.570333] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.570599] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.570829] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.571056] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-2af82b87-13ab-4ac1-bc0c-f716ca3f0999" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.926250] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a1330db-f7f7-44e4-a96f-88757581f92f in Status: SUCCESS [ 758.926499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.027509] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 759.027621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.284912] env[69777]: INFO networking_nsxv3.common.synchronization [req-bf2f867f-c586-4957-9412-3e3b6b4a0632 req-dc91a61f-46f0-400f-9bd0-e531694835a1 service nova] Enqueued Resource ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d with Priority: HIGHEST for action security_group_rules [ 759.285143] env[69777]: INFO networking_nsxv3.common.synchronization [req-bf2f867f-c586-4957-9412-3e3b6b4a0632 req-dc91a61f-46f0-400f-9bd0-e531694835a1 service nova] Enqueued Resource ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d with Priority: HIGHEST for action security_group_members [ 759.285309] env[69777]: INFO networking_nsxv3.common.synchronization [req-bf2f867f-c586-4957-9412-3e3b6b4a0632 req-dc91a61f-46f0-400f-9bd0-e531694835a1 service nova] Enqueued Resource ID: 2af82b87-13ab-4ac1-bc0c-f716ca3f0999 with Priority: HIGHEST for action port [ 759.285539] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d with Priority: HIGHEST for action security_group_rules [ 759.285665] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d with Priority: HIGHEST for action security_group_members [ 759.285786] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2af82b87-13ab-4ac1-bc0c-f716ca3f0999 with Priority: HIGHEST for action port [ 759.286408] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.286544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.286594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.286847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.286929] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d3eb17a-d8a9-4390-bb23-b2dd83171c7d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.288257] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.288376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.288432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.288597] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.288743] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.288842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.289126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.289126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.289188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.289226] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d3eb17a-d8a9-4390-bb23-b2dd83171c7d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.289915] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2af82b87-13ab-4ac1-bc0c-f716ca3f0999 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.290777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2af82b87-13ab-4ac1-bc0c-f716ca3f0999" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.290777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2af82b87-13ab-4ac1-bc0c-f716ca3f0999" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.290777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2af82b87-13ab-4ac1-bc0c-f716ca3f0999" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.290777] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2af82b87-13ab-4ac1-bc0c-f716ca3f0999',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.792557] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d3eb17a-d8a9-4390-bb23-b2dd83171c7d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.793467] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.793557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.796345] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2af82b87-13ab-4ac1-bc0c-f716ca3f0999 with status ACTIVE [ 759.796345] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.796345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.796499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.796570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.796659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.796951] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.796951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.796951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.797188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.797267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.797450] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.798477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.798477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.798477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.798477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.798477] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2af82b87-13ab-4ac1-bc0c-f716ca3f0999 is going to be updated. [ 759.818209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.818288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.818355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.818535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.818769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.818882] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2af82b87-13ab-4ac1-bc0c-f716ca3f0999" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.295191] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d3eb17a-d8a9-4390-bb23-b2dd83171c7d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.301333] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 760.301501] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 deletion is rescheduled due to dependency. [ 760.301601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.301768] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.301979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.305445] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.305577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.305645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.305860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.305918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.306079] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.379746] env[69777]: INFO networking_nsxv3.common.synchronization [req-f0796c5f-7bb0-45eb-964a-9324fdc6aee1 req-cae8ed5d-ebf5-4f86-9f42-60460ff05103 tempest-ServerRescueNegativeTestJSON-1534204294 tempest-ServerRescueNegativeTestJSON-1534204294-project-member] Enqueued Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 760.380323] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 760.380630] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.380747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.380807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.381067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.381226] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.381325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.381383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.381533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.381617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.381706] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.716081] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.716205] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.716330] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.716642] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.716892] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.717051] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.717254] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.717471] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.717611] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.717811] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.717918] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.718032] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.718136] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.718238] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.718335] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.718458] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.738409] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.738581] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 760.738721] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.738897] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.739643] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-453df7f0-1f2c-43f7-8b00-f0e069f6a940 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.739842] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-453df7f0-1f2c-43f7-8b00-f0e069f6a940" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.739970] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-453df7f0-1f2c-43f7-8b00-f0e069f6a940" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.740313] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-453df7f0-1f2c-43f7-8b00-f0e069f6a940" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.740459] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('453df7f0-1f2c-43f7-8b00-f0e069f6a940',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.803494] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.803494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.803494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.803494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.803494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.803494] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d is going to be created. [ 760.811327] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.811327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.811327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.811327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.811327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.811327] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.811327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.811327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.811327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.811327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.811327] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 760.831514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.831668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.831739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.831941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.832165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.833927] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.834077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.834128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.834460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.834460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.845279] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 760.845279] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d in Status: UNINITIALIZED for 2s [ 760.884322] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.884552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.884630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.885621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.885720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.886050] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.886140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.886283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.886389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.886484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.886600] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 already deleted. [ 760.886684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.253366] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.253366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.253366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.253366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.253366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.253366] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 453df7f0-1f2c-43f7-8b00-f0e069f6a940 not found, creating... [ 761.253366] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.253366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.253366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.253366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.253366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.259446] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.259446] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.259446] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.259446] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.259446] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.259446] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 453df7f0-1f2c-43f7-8b00-f0e069f6a940 is going to be created. [ 761.277526] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.278022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.278305] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.278711] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.279788] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.279788] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-453df7f0-1f2c-43f7-8b00-f0e069f6a940" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.036584] env[69777]: INFO networking_nsxv3.common.synchronization [req-f0796c5f-7bb0-45eb-964a-9324fdc6aee1 req-84223843-be46-451e-be2f-c6dcc1682533 service nova] Enqueued Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_rules [ 762.036820] env[69777]: INFO networking_nsxv3.common.synchronization [req-f0796c5f-7bb0-45eb-964a-9324fdc6aee1 req-84223843-be46-451e-be2f-c6dcc1682533 service nova] Enqueued Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 762.036858] env[69777]: INFO networking_nsxv3.common.synchronization [req-f0796c5f-7bb0-45eb-964a-9324fdc6aee1 req-84223843-be46-451e-be2f-c6dcc1682533 service nova] Enqueued Resource ID: 453df7f0-1f2c-43f7-8b00-f0e069f6a940 with Priority: HIGHEST for action port [ 762.037456] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_rules [ 762.037626] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 762.037689] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453df7f0-1f2c-43f7-8b00-f0e069f6a940 with Priority: HIGHEST for action port [ 762.037933] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.038436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.038515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.038769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.038855] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.040076] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.040076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.040076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.040224] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.040344] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.040437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.040499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.040812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.040906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.041009] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.043757] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-453df7f0-1f2c-43f7-8b00-f0e069f6a940 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.043858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-453df7f0-1f2c-43f7-8b00-f0e069f6a940" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.043928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-453df7f0-1f2c-43f7-8b00-f0e069f6a940" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.044098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-453df7f0-1f2c-43f7-8b00-f0e069f6a940" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.044174] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('453df7f0-1f2c-43f7-8b00-f0e069f6a940',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.546346] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.546501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.546628] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.547587] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 453df7f0-1f2c-43f7-8b00-f0e069f6a940 with status ACTIVE [ 762.547698] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.547808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.547866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.548090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.549039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.549039] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.549039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.549039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.549039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.549039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.549332] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.549332] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.549332] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.549439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.549439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.549495] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 453df7f0-1f2c-43f7-8b00-f0e069f6a940 is going to be updated. [ 762.570439] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.570579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.570649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.570838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.570966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.571132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-453df7f0-1f2c-43f7-8b00-f0e069f6a940" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.855444] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d in Status: SUCCESS [ 762.855677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.855846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.856128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.856332] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.856457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.856524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.856691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.856783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.856886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.856983] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d3eb17a-d8a9-4390-bb23-b2dd83171c7d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.858537] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 762.858720] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 deletion is rescheduled due to dependency. [ 762.858800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.051857] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.360654] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.360747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.360840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.361158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.361529] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.361591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.361652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.361959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.361959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.362109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.362292] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.362402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.362465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.362643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.362785] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.362879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.362939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.363092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.363211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.363326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.363432] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d3eb17a-d8a9-4390-bb23-b2dd83171c7d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.555820] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.555820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.555820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.556304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.556304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.556304] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 is going to be created. [ 763.580302] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.580457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.580529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.580755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.580941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.592243] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: UNINITIALIZED for 2s [ 763.865506] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d: rpc.has_security_group_logging(os_id): False [ 763.883277] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.883442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.883514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.883779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.883949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.884090] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.884203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.884272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.884421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.884511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.884714] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.884816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.884887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.885055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.885156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.885427] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.885559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.885618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.885718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.885789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.885892] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d is going to be created. [ 763.939699] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.939849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.939937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.940591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.940591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.950411] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d in Status: IN_PROGRESS for 2s [ 765.543099] env[69777]: INFO networking_nsxv3.common.synchronization [req-e56a511f-1ee0-4e1a-a5fc-bbae864aa1c6 req-54cde4eb-cffb-46b9-bfd8-10b9d4b9865e tempest-ServerMetadataTestJSON-1099393728 tempest-ServerMetadataTestJSON-1099393728-project-member] Enqueued Resource ID: 8a1330db-f7f7-44e4-a96f-88757581f92f with Priority: HIGHEST for action security_group_members [ 765.543629] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1330db-f7f7-44e4-a96f-88757581f92f with Priority: HIGHEST for action security_group_members [ 765.543933] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a1330db-f7f7-44e4-a96f-88757581f92f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.544069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.544140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.544341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.544492] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.544593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.544657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.544799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.544883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.544973] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a1330db-f7f7-44e4-a96f-88757581f92f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.603119] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: SUCCESS [ 765.603242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.603291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.603502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.603685] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.603806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.603872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.604027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.604110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.604194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.604282] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.965102] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d in Status: SUCCESS [ 765.965102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.052341] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.052341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.052341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.052341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.052341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.052341] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.052341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.052341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.052341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.052341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.052341] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a1330db-f7f7-44e4-a96f-88757581f92f is going to be updated. [ 766.088030] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.088030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.088030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.088030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.088030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.098632] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a1330db-f7f7-44e4-a96f-88757581f92f in Status: IN_PROGRESS for 2s [ 766.107597] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.107910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.107910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.108075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.108278] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.108384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.108440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.108579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.108680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.108760] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.108931] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.109044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.109163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.109244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.109558] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.109558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.109558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.109756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.109756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.109927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.109927] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.613348] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c23d2309-9b2a-41c1-ba25-e613842d4d53: rpc.has_security_group_logging(os_id): False [ 766.635484] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.635644] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.635644] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.635960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.635960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.637545] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.637545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.637545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.637545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.637545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.637545] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.637545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.637545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.637545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.637545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.637928] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.637928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.637928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.637928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.637928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.638100] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 is going to be created. [ 766.721535] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.721680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.721749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.721961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.723135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.738612] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: IN_PROGRESS for 2s [ 768.114631] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a1330db-f7f7-44e4-a96f-88757581f92f in Status: SUCCESS [ 768.114631] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a1330db-f7f7-44e4-a96f-88757581f92f deletion is rescheduled due to dependency. [ 768.114631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.219113] env[69777]: INFO networking_nsxv3.common.synchronization [req-157f0383-984b-4561-8f9d-1ba4dbe2c5e5 req-f5d9e610-6eef-4650-a6b9-9816b0c8093f tempest-ServerRescueNegativeTestJSON-1534204294 tempest-ServerRescueNegativeTestJSON-1534204294-project-member] Enqueued Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 768.219113] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 768.219113] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.219113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.219113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.219859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.220272] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.220544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.220728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.222896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.222896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.222896] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.724725] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.746452] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.746665] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.746790] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.747085] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.747425] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.747585] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.747703] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.747956] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.751214] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.751214] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.751214] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.751214] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.751214] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.751214] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.751446] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.751480] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.753257] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: SUCCESS [ 768.753349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.771293] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.771293] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.771293] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.771293] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.771293] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-80798ced-c6ed-4817-b7ae-fddb3a600fc2 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.771293] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-80798ced-c6ed-4817-b7ae-fddb3a600fc2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.771553] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-80798ced-c6ed-4817-b7ae-fddb3a600fc2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.773053] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-80798ced-c6ed-4817-b7ae-fddb3a600fc2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.773053] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80798ced-c6ed-4817-b7ae-fddb3a600fc2',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.231304] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.275090] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.275492] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.275682] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.279020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.279020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.279020] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 80798ced-c6ed-4817-b7ae-fddb3a600fc2 not found, creating... [ 769.279020] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.279020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.279020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.279020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.279020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.279020] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.279020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.279822] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.279822] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.279822] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.279822] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 80798ced-c6ed-4817-b7ae-fddb3a600fc2 is going to be created. [ 769.283487] env[69777]: INFO networking_nsxv3.common.synchronization [None req-314a052e-4803-46a4-9708-3019fa6c4e1f None None] Enqueued Resource ID: 385be96b-d9a4-4282-ab82-c38f28db07c7 with Priority: HIGHEST for action port [ 769.285291] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 385be96b-d9a4-4282-ab82-c38f28db07c7 with Priority: HIGHEST for action port [ 769.286041] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-385be96b-d9a4-4282-ab82-c38f28db07c7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.286285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-385be96b-d9a4-4282-ab82-c38f28db07c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.286416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-385be96b-d9a4-4282-ab82-c38f28db07c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.286702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-385be96b-d9a4-4282-ab82-c38f28db07c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.287101] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('385be96b-d9a4-4282-ab82-c38f28db07c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.303047] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.303047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.303047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.303047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.303047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.303047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-80798ced-c6ed-4817-b7ae-fddb3a600fc2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.734210] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.734375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.734445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.734731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.734802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.734901] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 is going to be updated. [ 769.761255] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.761737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.761877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.762158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.762743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.770821] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: IN_PROGRESS for 2s [ 769.789034] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 385be96b-d9a4-4282-ab82-c38f28db07c7 [ 769.789208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.789331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.789398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.789690] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.789774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.789867] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:385be96b-d9a4-4282-ab82-c38f28db07c7 already deleted. [ 769.789942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-385be96b-d9a4-4282-ab82-c38f28db07c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.116177] env[69777]: INFO networking_nsxv3.common.synchronization [req-157f0383-984b-4561-8f9d-1ba4dbe2c5e5 req-d42bfbcc-01c0-4509-ab93-61f476193654 service nova] Enqueued Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_rules [ 770.116177] env[69777]: INFO networking_nsxv3.common.synchronization [req-157f0383-984b-4561-8f9d-1ba4dbe2c5e5 req-d42bfbcc-01c0-4509-ab93-61f476193654 service nova] Enqueued Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 770.116177] env[69777]: INFO networking_nsxv3.common.synchronization [req-157f0383-984b-4561-8f9d-1ba4dbe2c5e5 req-d42bfbcc-01c0-4509-ab93-61f476193654 service nova] Enqueued Resource ID: 80798ced-c6ed-4817-b7ae-fddb3a600fc2 with Priority: HIGHEST for action port [ 770.116353] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_rules [ 770.116560] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 770.116729] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80798ced-c6ed-4817-b7ae-fddb3a600fc2 with Priority: HIGHEST for action port [ 770.116969] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.121023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.121023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.121023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.121023] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.121023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.121023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.121023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-80798ced-c6ed-4817-b7ae-fddb3a600fc2 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.121023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80798ced-c6ed-4817-b7ae-fddb3a600fc2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.121023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80798ced-c6ed-4817-b7ae-fddb3a600fc2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.121023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80798ced-c6ed-4817-b7ae-fddb3a600fc2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.121023] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80798ced-c6ed-4817-b7ae-fddb3a600fc2',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.623545] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80798ced-c6ed-4817-b7ae-fddb3a600fc2 with status ACTIVE [ 770.623545] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.627140] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.627140] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.627140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.627140] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80798ced-c6ed-4817-b7ae-fddb3a600fc2 is going to be updated. [ 770.628021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.628195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.652534] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.652701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.652875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.653115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.653221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.653340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80798ced-c6ed-4817-b7ae-fddb3a600fc2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.987030] env[69777]: INFO networking_nsxv3.common.synchronization [req-174d208c-81a5-4bc5-aa03-09fc01200411 req-83c2d126-0522-42dd-bc23-6eb4d9c32a94 tempest-DeleteServersAdminTestJSON-1268258336 tempest-DeleteServersAdminTestJSON-1268258336-project-member] Enqueued Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 770.987585] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 770.988204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.988204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.988204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.988396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.988426] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.988525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.988570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.988714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.988798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.988907] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.303822] env[69777]: INFO networking_nsxv3.common.synchronization [None req-bc0931dc-8188-4ca6-bfc3-3df09b4df391 None None] Enqueued Resource ID: d3ae4eb3-8aa3-46a0-bf2f-0812c8410f6b with Priority: HIGHEST for action port [ 771.304511] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3ae4eb3-8aa3-46a0-bf2f-0812c8410f6b with Priority: HIGHEST for action port [ 771.304888] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3ae4eb3-8aa3-46a0-bf2f-0812c8410f6b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.305055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3ae4eb3-8aa3-46a0-bf2f-0812c8410f6b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.305142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3ae4eb3-8aa3-46a0-bf2f-0812c8410f6b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.305465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3ae4eb3-8aa3-46a0-bf2f-0812c8410f6b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.305570] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3ae4eb3-8aa3-46a0-bf2f-0812c8410f6b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.465849] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.466050] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.466172] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.466438] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.466727] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.467628] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.467628] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.467628] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.467628] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.467628] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.467836] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.467836] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.467897] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.468042] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.468128] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.468272] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.487514] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.487671] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 771.487834] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.487975] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.488319] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-5c7b979a-c90f-42a5-b14f-4d7c840f35eb taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.488511] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-5c7b979a-c90f-42a5-b14f-4d7c840f35eb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.488618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-5c7b979a-c90f-42a5-b14f-4d7c840f35eb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.488936] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-5c7b979a-c90f-42a5-b14f-4d7c840f35eb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.489101] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c7b979a-c90f-42a5-b14f-4d7c840f35eb',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.493511] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.493629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.493698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.493871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.493959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.494145] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.494238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.494302] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.494442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.494518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.494600] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 is going to be updated. [ 771.519194] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.519349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.519438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.519656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.519810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.528313] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: IN_PROGRESS for 2s [ 771.797018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: SUCCESS [ 771.797018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.797018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.797018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.797018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.797018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.797018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.797018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.797018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.797018] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.810018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3ae4eb3-8aa3-46a0-bf2f-0812c8410f6b [ 771.810018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.810018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.810018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.810018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.810018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.810018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3ae4eb3-8aa3-46a0-bf2f-0812c8410f6b already deleted. [ 771.810018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3ae4eb3-8aa3-46a0-bf2f-0812c8410f6b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.994938] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.995110] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.995232] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.995587] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.995798] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.996013] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 5c7b979a-c90f-42a5-b14f-4d7c840f35eb not found, creating... [ 771.996361] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.996586] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.996721] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.997050] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.997340] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.997611] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.999024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.999024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.999024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.999024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.999024] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 5c7b979a-c90f-42a5-b14f-4d7c840f35eb is going to be created. [ 772.017590] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.017909] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.018120] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.018619] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.018756] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.019867] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-5c7b979a-c90f-42a5-b14f-4d7c840f35eb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.302531] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.807278] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.014237] env[69777]: INFO networking_nsxv3.common.synchronization [req-174d208c-81a5-4bc5-aa03-09fc01200411 req-98297958-6f24-4c91-a54e-1256f2f56a3f service nova] Enqueued Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_rules [ 773.014429] env[69777]: INFO networking_nsxv3.common.synchronization [req-174d208c-81a5-4bc5-aa03-09fc01200411 req-98297958-6f24-4c91-a54e-1256f2f56a3f service nova] Enqueued Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 773.015901] env[69777]: INFO networking_nsxv3.common.synchronization [req-174d208c-81a5-4bc5-aa03-09fc01200411 req-98297958-6f24-4c91-a54e-1256f2f56a3f service nova] Enqueued Resource ID: 5c7b979a-c90f-42a5-b14f-4d7c840f35eb with Priority: HIGHEST for action port [ 773.015901] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_rules [ 773.015901] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 773.015901] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7b979a-c90f-42a5-b14f-4d7c840f35eb with Priority: HIGHEST for action port [ 773.015901] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.015901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.015901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.016624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.016624] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.019262] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.019262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.019262] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c7b979a-c90f-42a5-b14f-4d7c840f35eb taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.019262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c7b979a-c90f-42a5-b14f-4d7c840f35eb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.019262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c7b979a-c90f-42a5-b14f-4d7c840f35eb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.019537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c7b979a-c90f-42a5-b14f-4d7c840f35eb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.019537] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c7b979a-c90f-42a5-b14f-4d7c840f35eb',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.310549] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.313066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.313066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.313066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.313066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.313066] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 is going to be updated. [ 773.338135] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.338318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.338375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.338718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.338718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.346810] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: IN_PROGRESS for 2s [ 773.521847] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.522096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.524173] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c7b979a-c90f-42a5-b14f-4d7c840f35eb with status ACTIVE [ 773.524173] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.524173] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.524173] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.524173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.524173] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c7b979a-c90f-42a5-b14f-4d7c840f35eb is going to be updated. [ 773.539754] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: SUCCESS [ 773.540012] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 deletion is rescheduled due to dependency. [ 773.540165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.540372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.540612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.540831] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.540961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.541061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.542261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.542261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.542261] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.546721] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.546721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.546721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.546721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.546721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.546721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c7b979a-c90f-42a5-b14f-4d7c840f35eb" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.043710] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.546864] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.050311] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.050591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.050675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.050850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.050960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.051077] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 is going to be updated. [ 775.078198] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.078198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.078198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.078198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.078198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.088189] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: IN_PROGRESS for 2s [ 775.356728] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: SUCCESS [ 775.356912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.357078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.357416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.357538] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.357659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.357719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.357905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.357985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.358109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.358257] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.862898] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.863555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.863631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.863891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.864148] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.864313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.864409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.864620] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.864745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.864863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.865091] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.865239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.865331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.865831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.866194] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.866194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.866293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.866462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.869777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.869777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.869777] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.032316] env[69777]: INFO networking_nsxv3.common.synchronization [req-ae95ec69-fcba-412b-9d2b-338585a6ef32 req-05fee9cc-e54d-4cd2-b423-5464486bd02b tempest-ServersTestFqdnHostnames-746215206 tempest-ServersTestFqdnHostnames-746215206-project-member] Enqueued Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_members [ 776.032863] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_members [ 776.033187] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.033328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.033397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.034441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.034513] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.034612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.034677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.034852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.035738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.035866] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.374246] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c23d2309-9b2a-41c1-ba25-e613842d4d53: rpc.has_security_group_logging(os_id): False [ 776.392103] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.392292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.395594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.397372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.397372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.397372] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.397372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.397372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.397372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.397372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.398026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.398162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.398237] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.398474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.398585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.398799] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.398898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.398964] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.399251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.399299] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.399388] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 is going to be updated. [ 776.494067] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.494293] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-209" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.494495] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-209" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.494743] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-209" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.495094] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.495185] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.495347] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.495571] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.495716] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.495929] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.496053] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.496455] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.496455] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.496455] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.496687] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.496767] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.500203] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.500203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.500203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.500203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.500203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.526300] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: IN_PROGRESS for 2s [ 776.532831] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.533168] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.533538] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.533814] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-209" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.534286] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-7ef4c0f0-cc42-478a-ba54-f281e207df08 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.534496] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-7ef4c0f0-cc42-478a-ba54-f281e207df08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.535608] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-7ef4c0f0-cc42-478a-ba54-f281e207df08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.535608] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-7ef4c0f0-cc42-478a-ba54-f281e207df08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.535608] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef4c0f0-cc42-478a-ba54-f281e207df08',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.541738] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.541914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.541948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.542245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.542351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.542605] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.544207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.544207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.544207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.544207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.544207] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 already deleted. [ 776.544207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.040209] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.040209] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.040209] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.040209] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.040209] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.040209] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 7ef4c0f0-cc42-478a-ba54-f281e207df08 not found, creating... [ 777.040209] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.040209] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.040642] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.040642] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.040839] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.041713] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.041713] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.041713] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.041713] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.041713] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.041900] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 7ef4c0f0-cc42-478a-ba54-f281e207df08 is going to be created. [ 777.061775] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.061775] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.061775] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.062101] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.062293] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.062616] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-7ef4c0f0-cc42-478a-ba54-f281e207df08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.078319] env[69777]: INFO networking_nsxv3.common.synchronization [req-78de5d13-7946-4a91-9dee-76d92fec86aa req-f8a0c35b-af80-4a90-9f43-87e0da1a4628 tempest-FloatingIPsAssociationNegativeTestJSON-1621898975 tempest-FloatingIPsAssociationNegativeTestJSON-1621898975-project-member] Enqueued Resource ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d with Priority: HIGHEST for action security_group_members [ 777.082226] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d with Priority: HIGHEST for action security_group_members [ 777.082930] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.083110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.083161] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.083816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.083816] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.083816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.083816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.083816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.084102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.084102] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d3eb17a-d8a9-4390-bb23-b2dd83171c7d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.103528] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: SUCCESS [ 777.103528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.103659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.104113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.104630] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.104630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.104810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.105545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.105657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.105760] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.105855] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.588592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.588592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.588592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.588592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.589068] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.589068] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.589068] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.589234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.589234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.590169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.590169] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d is going to be updated. [ 777.609793] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.609793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.609793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.609793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.609793] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.609793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.609793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.609793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.610141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.610141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.610141] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.610293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.610293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.611109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.611109] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.611109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.611109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.611109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.611109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.611109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.611109] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.623947] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.623947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.624151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.624198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.624369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.634617] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d in Status: IN_PROGRESS for 2s [ 777.858389] env[69777]: INFO networking_nsxv3.common.synchronization [req-ae95ec69-fcba-412b-9d2b-338585a6ef32 req-a330d016-5a24-497b-a34e-d7b80055b8a7 service nova] Enqueued Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_rules [ 777.858578] env[69777]: INFO networking_nsxv3.common.synchronization [req-ae95ec69-fcba-412b-9d2b-338585a6ef32 req-a330d016-5a24-497b-a34e-d7b80055b8a7 service nova] Enqueued Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_members [ 777.858761] env[69777]: INFO networking_nsxv3.common.synchronization [req-ae95ec69-fcba-412b-9d2b-338585a6ef32 req-a330d016-5a24-497b-a34e-d7b80055b8a7 service nova] Enqueued Resource ID: 7ef4c0f0-cc42-478a-ba54-f281e207df08 with Priority: HIGHEST for action port [ 777.862612] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_rules [ 777.862696] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_members [ 777.862757] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef4c0f0-cc42-478a-ba54-f281e207df08 with Priority: HIGHEST for action port [ 777.863015] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.863287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.863367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.863554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.863659] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.864560] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.864702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.864769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.864917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.865098] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.865261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.865550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.865550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.865682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.865682] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.866421] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ef4c0f0-cc42-478a-ba54-f281e207df08 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.866570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ef4c0f0-cc42-478a-ba54-f281e207df08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.866642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ef4c0f0-cc42-478a-ba54-f281e207df08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.866724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ef4c0f0-cc42-478a-ba54-f281e207df08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.867705] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef4c0f0-cc42-478a-ba54-f281e207df08',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.114351] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eabc2a2-99dc-4c4c-844b-193f2dc6c288: rpc.has_security_group_logging(os_id): False [ 778.134095] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.134313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.134414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.135861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.135861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.135861] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.135861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.135861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.136268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.136268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.136360] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.136425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.136478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.136575] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.136653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.136847] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.136942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.136996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.137155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.137230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.137387] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 is going to be updated. [ 778.200902] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.200902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.200902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.200902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.200902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.226751] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: IN_PROGRESS for 2s [ 778.373317] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.373451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.373664] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.374570] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ef4c0f0-cc42-478a-ba54-f281e207df08 with status ACTIVE [ 778.378034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.378034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.378034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.378034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.378034] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ef4c0f0-cc42-478a-ba54-f281e207df08 is going to be updated. [ 778.398162] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.398329] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.398412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.398619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.398773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.398944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ef4c0f0-cc42-478a-ba54-f281e207df08" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.541346] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: SUCCESS [ 778.541346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.881047] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.928123] env[69777]: INFO networking_nsxv3.common.synchronization [req-57426daf-0486-4526-ab89-346587f4b988 req-d2fdc06d-29ac-45cf-a614-c846de7a66af tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 778.928806] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 778.929293] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.929615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.929615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.929869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.930119] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.930205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.930250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.930441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.930595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.930595] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.062443] env[69777]: INFO networking_nsxv3.common.synchronization [None req-09ad088e-fc94-4bfb-972c-b8b217fff82e None None] Enqueued Resource ID: ac34c0a4-0193-4fed-a222-d2a424f1043d with Priority: HIGHEST for action port [ 779.062443] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac34c0a4-0193-4fed-a222-d2a424f1043d with Priority: HIGHEST for action port [ 779.062443] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac34c0a4-0193-4fed-a222-d2a424f1043d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.062443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac34c0a4-0193-4fed-a222-d2a424f1043d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.062443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac34c0a4-0193-4fed-a222-d2a424f1043d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.062668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac34c0a4-0193-4fed-a222-d2a424f1043d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.062668] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac34c0a4-0193-4fed-a222-d2a424f1043d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.384734] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.384734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.384734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.384734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.384734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.384734] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 is going to be created. [ 779.433805] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.434356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.434555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.438124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.438124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.438124] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.438124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.438124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.438124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.438124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.438124] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e already deleted. [ 779.438124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.504753] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.504753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.504753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.504943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.505107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.514389] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 in Status: UNINITIALIZED for 2s [ 779.565026] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac34c0a4-0193-4fed-a222-d2a424f1043d [ 779.565348] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.565483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.565559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.565817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.565957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.566027] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac34c0a4-0193-4fed-a222-d2a424f1043d already deleted. [ 779.566084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac34c0a4-0193-4fed-a222-d2a424f1043d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.646813] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d in Status: SUCCESS [ 779.647020] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d deletion is rescheduled due to dependency. [ 779.647147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.063510] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.063908] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.063908] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.064221] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.064410] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.064595] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.064678] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.064919] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.066362] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.066624] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.066827] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.066895] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.066961] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.067100] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.067200] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.067406] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.088764] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.088943] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 780.089095] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.089300] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.089646] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-c304a720-453f-4a7d-b359-9e6d2c740322 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.089775] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-c304a720-453f-4a7d-b359-9e6d2c740322" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.089864] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-c304a720-453f-4a7d-b359-9e6d2c740322" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.092336] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-c304a720-453f-4a7d-b359-9e6d2c740322" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.092336] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c304a720-453f-4a7d-b359-9e6d2c740322',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.243103] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: SUCCESS [ 780.243364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.595546] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.595546] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.595546] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.595546] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.595881] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.595952] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port c304a720-453f-4a7d-b359-9e6d2c740322 not found, creating... [ 780.596234] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.596547] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.596608] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.596829] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.596972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.601583] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.601583] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.601583] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.601583] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.601583] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.601583] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: c304a720-453f-4a7d-b359-9e6d2c740322 is going to be created. [ 780.623299] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.623299] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.623299] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.623299] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.623299] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.623299] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-c304a720-453f-4a7d-b359-9e6d2c740322" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.059280] env[69777]: INFO networking_nsxv3.common.synchronization [None req-667bbb8d-9d09-4e32-a574-7113d9b227a3 tempest-ServerActionsTestOtherB-1106354566 tempest-ServerActionsTestOtherB-1106354566-project-member] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 781.059280] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 781.059632] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.059632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.059632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.059894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.059979] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.167316] env[69777]: INFO networking_nsxv3.common.synchronization [None req-629953b0-1b16-47eb-853c-530c0e503eae tempest-ServerActionsTestOtherB-1106354566 tempest-ServerActionsTestOtherB-1106354566-project-member] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 781.167316] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 781.168794] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.169739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.196966] env[69777]: INFO networking_nsxv3.common.synchronization [None req-e7afca81-4609-4827-8434-a6bf5d7e39cd None None] Enqueued Resource ID: c668c4e2-4f19-418c-b4ae-5ff08c4ad3bc with Priority: HIGHEST for action port [ 781.196966] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c668c4e2-4f19-418c-b4ae-5ff08c4ad3bc with Priority: HIGHEST for action port [ 781.197622] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-c668c4e2-4f19-418c-b4ae-5ff08c4ad3bc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.197883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c668c4e2-4f19-418c-b4ae-5ff08c4ad3bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.198099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c668c4e2-4f19-418c-b4ae-5ff08c4ad3bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.198560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c668c4e2-4f19-418c-b4ae-5ff08c4ad3bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.200214] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c668c4e2-4f19-418c-b4ae-5ff08c4ad3bc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.496041] env[69777]: INFO networking_nsxv3.common.synchronization [req-57426daf-0486-4526-ab89-346587f4b988 req-b9b8c522-3a33-4a31-964b-8a3962ae9d6b service nova] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_rules [ 781.496041] env[69777]: INFO networking_nsxv3.common.synchronization [req-57426daf-0486-4526-ab89-346587f4b988 req-b9b8c522-3a33-4a31-964b-8a3962ae9d6b service nova] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 781.496041] env[69777]: INFO networking_nsxv3.common.synchronization [req-57426daf-0486-4526-ab89-346587f4b988 req-b9b8c522-3a33-4a31-964b-8a3962ae9d6b service nova] Enqueued Resource ID: c304a720-453f-4a7d-b359-9e6d2c740322 with Priority: HIGHEST for action port [ 781.496041] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_rules [ 781.496041] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 781.496041] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c304a720-453f-4a7d-b359-9e6d2c740322 with Priority: HIGHEST for action port [ 781.496041] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.496041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.497977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.497977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.497977] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.498781] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.499178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.499372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.499625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.500884] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.500884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.500884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.500884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.500884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.500884] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.502677] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-c304a720-453f-4a7d-b359-9e6d2c740322 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.506301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c304a720-453f-4a7d-b359-9e6d2c740322" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.506301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c304a720-453f-4a7d-b359-9e6d2c740322" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.506301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c304a720-453f-4a7d-b359-9e6d2c740322" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.506301] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c304a720-453f-4a7d-b359-9e6d2c740322',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.524679] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 in Status: SUCCESS [ 781.524922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.525136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.525377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.526017] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.526017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.526017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.526017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.526458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.526458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.526458] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.581854] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.581854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.581854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.581854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.581854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.581854] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 already deleted. [ 781.581854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.581854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.581854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.581854] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.660749] env[69777]: INFO networking_nsxv3.common.synchronization [req-c0bc7af2-4281-4868-98f8-2e5396e018f5 req-023aaa59-f0fd-4b1f-be54-4c066b48a01d tempest-ServersV294TestFqdnHostnames-207069780 tempest-ServersV294TestFqdnHostnames-207069780-project-member] Enqueued Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_members [ 781.661268] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_members [ 781.661578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-af922b11-ba63-48cf-97cd-b04487c3e7f1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.661702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.661768] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.662010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.662407] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.662521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.662573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.662742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.662889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.663330] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.704024] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c668c4e2-4f19-418c-b4ae-5ff08c4ad3bc [ 781.704024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.704024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.704024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.704024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.704024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.704024] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c668c4e2-4f19-418c-b4ae-5ff08c4ad3bc already deleted. [ 781.704024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c668c4e2-4f19-418c-b4ae-5ff08c4ad3bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.003619] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.008177] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c304a720-453f-4a7d-b359-9e6d2c740322 with status ACTIVE [ 782.008177] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.008177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.008655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.008655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.008655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.008767] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.008767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.008853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.008985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.009069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.009243] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.009334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.009396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.009543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.009620] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.009879] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c304a720-453f-4a7d-b359-9e6d2c740322 is going to be updated. [ 782.012110] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.012215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.031181] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.031325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.031405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.031602] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.031734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.031919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c304a720-453f-4a7d-b359-9e6d2c740322" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.032222] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.084148] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-589 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.084148] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-589" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.084148] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-589" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.084148] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-589" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.084148] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.084414] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.084414] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.084519] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.084656] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.084851] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.084957] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.085079] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.085193] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.085316] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.085420] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.085548] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.119128] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.119319] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 782.119460] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.119677] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-589" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.120014] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-b47d160d-5812-4d8e-b5c4-fcd292ac0e02 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.120198] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-b47d160d-5812-4d8e-b5c4-fcd292ac0e02" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.120325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-b47d160d-5812-4d8e-b5c4-fcd292ac0e02" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.120647] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-b47d160d-5812-4d8e-b5c4-fcd292ac0e02" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.120787] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47d160d-5812-4d8e-b5c4-fcd292ac0e02',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.126868] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.126868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.126868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.126868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.126868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.126868] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 already deleted. [ 782.126868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.166320] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.166505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.166556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.167670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.167670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.167670] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.167670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.167670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.167670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.167670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.167670] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 already deleted. [ 782.168317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.507888] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.535367] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19a7e89f-21d0-44aa-b9fb-f52ca92dc496: rpc.has_security_group_logging(os_id): False [ 782.553161] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.554491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.554491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.554491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.554491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.554491] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.554491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.554491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.554491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.554491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.554491] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 is going to be created. [ 782.613660] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.613783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.613844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.614072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.614256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.623196] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.623828] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.623828] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.624050] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.624276] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.624501] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port b47d160d-5812-4d8e-b5c4-fcd292ac0e02 not found, creating... [ 782.626344] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.626344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.626344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.626344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.626344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.626344] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.626344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.626344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.626344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.626655] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.626655] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: b47d160d-5812-4d8e-b5c4-fcd292ac0e02 is going to be created. [ 782.628367] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 in Status: IN_PROGRESS for 2s [ 782.652060] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.652060] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.652060] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.652060] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.652060] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.652060] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-b47d160d-5812-4d8e-b5c4-fcd292ac0e02" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.014253] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.014955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.014955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.014955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.014955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.014955] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be created. [ 783.041605] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.041783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.041845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.042038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.042189] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.050623] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: UNINITIALIZED for 2s [ 783.385191] env[69777]: INFO networking_nsxv3.common.synchronization [req-c0bc7af2-4281-4868-98f8-2e5396e018f5 req-b2288353-471a-4401-99bb-e93e5c031ace service nova] Enqueued Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_rules [ 783.385191] env[69777]: INFO networking_nsxv3.common.synchronization [req-c0bc7af2-4281-4868-98f8-2e5396e018f5 req-b2288353-471a-4401-99bb-e93e5c031ace service nova] Enqueued Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_members [ 783.385191] env[69777]: INFO networking_nsxv3.common.synchronization [req-c0bc7af2-4281-4868-98f8-2e5396e018f5 req-b2288353-471a-4401-99bb-e93e5c031ace service nova] Enqueued Resource ID: b47d160d-5812-4d8e-b5c4-fcd292ac0e02 with Priority: HIGHEST for action port [ 783.385191] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_rules [ 783.385191] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_members [ 783.385641] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47d160d-5812-4d8e-b5c4-fcd292ac0e02 with Priority: HIGHEST for action port [ 783.385770] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af922b11-ba63-48cf-97cd-b04487c3e7f1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.385949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.385949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.390021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.390021] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.390021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-af922b11-ba63-48cf-97cd-b04487c3e7f1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.392206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.392206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.392206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.392206] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.392206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.392206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.392206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.392206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.392206] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.392945] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b47d160d-5812-4d8e-b5c4-fcd292ac0e02 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.395216] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b47d160d-5812-4d8e-b5c4-fcd292ac0e02" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.396024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b47d160d-5812-4d8e-b5c4-fcd292ac0e02" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.396024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b47d160d-5812-4d8e-b5c4-fcd292ac0e02" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.396024] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47d160d-5812-4d8e-b5c4-fcd292ac0e02',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.897025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-af922b11-ba63-48cf-97cd-b04487c3e7f1 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.897238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.897492] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.900632] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b47d160d-5812-4d8e-b5c4-fcd292ac0e02 with status ACTIVE [ 783.900907] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.901012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.901070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.901242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.901392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.901625] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.901743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.901834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.901940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.902043] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.902209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.902308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.902371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.902483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.902558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.902639] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b47d160d-5812-4d8e-b5c4-fcd292ac0e02 is going to be updated. [ 783.931021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.931021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.931021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.931021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.931021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.931021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b47d160d-5812-4d8e-b5c4-fcd292ac0e02" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.404518] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.494066] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f439f28-969e-4f59-a6c3-e1045a881e65 req-bc0d9ede-f7da-404c-a165-497c8502e7ba tempest-MultipleCreateTestJSON-2061516794 tempest-MultipleCreateTestJSON-2061516794-project-member] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 784.495702] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 784.495702] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.495702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.495702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.495702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.495996] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.495996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.495996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.496169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.496298] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.496410] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.640372] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 in Status: SUCCESS [ 784.642462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.906808] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.907065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.907065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.907277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.907407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.907515] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 is going to be created. [ 784.932027] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.932185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.932441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.932769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.932913] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.942123] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 in Status: UNINITIALIZED for 2s [ 784.999919] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.000133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.000238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.000471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.000569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.000780] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.000894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.001105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.001105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.001177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.001258] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 already deleted. [ 785.001295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.064321] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 785.064321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.064321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.064321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.064321] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.064321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.064321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.064321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.064321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.064321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.064321] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.173919] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.174143] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.174270] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.174613] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.174878] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.175057] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.175181] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.175453] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.175605] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.175870] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 785.175939] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.176036] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.176150] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.176260] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 785.176368] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.176500] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.193298] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.193471] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 785.193611] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.193790] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.194118] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-8556daf1-d4ef-4180-9014-ea500a9223db taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.194294] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-8556daf1-d4ef-4180-9014-ea500a9223db" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.194415] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-8556daf1-d4ef-4180-9014-ea500a9223db" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.194737] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-8556daf1-d4ef-4180-9014-ea500a9223db" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.194878] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8556daf1-d4ef-4180-9014-ea500a9223db',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.201716] env[69777]: INFO networking_nsxv3.common.synchronization [req-c86e0aae-1a8e-413d-9581-9630ea7a2ad0 req-6e8e05d6-2eed-4d84-9182-c093b172a342 tempest-DeleteServersAdminTestJSON-1268258336 tempest-DeleteServersAdminTestJSON-1268258336-project-member] Enqueued Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 785.202093] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGHEST for action security_group_members [ 785.202395] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.203308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.203308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.203308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.203308] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.203308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.203308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.203308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.203308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.203717] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.565360] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.697741] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.698123] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.698215] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.698759] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.698953] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.699174] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 8556daf1-d4ef-4180-9014-ea500a9223db not found, creating... [ 785.699550] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.700245] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.700245] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.700245] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.700392] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.700773] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.701024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.701208] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.701605] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.701872] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.702176] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 8556daf1-d4ef-4180-9014-ea500a9223db is going to be created. [ 785.705293] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.705455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.705552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.705758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.705884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.706114] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.706235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.706314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.706510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.706657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.706815] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 is going to be updated. [ 785.724772] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.724989] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.725134] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.725459] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.725717] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.725956] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-8556daf1-d4ef-4180-9014-ea500a9223db" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.736210] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.737031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.737031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.737031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.737031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.745561] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: IN_PROGRESS for 2s [ 786.068679] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d94c1310-5466-4ce7-9d83-c7c474aa637e: rpc.has_security_group_logging(os_id): False [ 786.086728] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.086862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.086936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.087162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.087252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.087514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.087610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.087671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.087806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.087891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.088036] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be created. [ 786.150399] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.150591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.150691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.150931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.151159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.160802] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: IN_PROGRESS for 2s [ 786.452204] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f439f28-969e-4f59-a6c3-e1045a881e65 req-f84ac867-0eaf-4060-be57-e3a8faf7603c service nova] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_rules [ 786.452204] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f439f28-969e-4f59-a6c3-e1045a881e65 req-f84ac867-0eaf-4060-be57-e3a8faf7603c service nova] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 786.452204] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f439f28-969e-4f59-a6c3-e1045a881e65 req-f84ac867-0eaf-4060-be57-e3a8faf7603c service nova] Enqueued Resource ID: 8556daf1-d4ef-4180-9014-ea500a9223db with Priority: HIGHEST for action port [ 786.452204] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_rules [ 786.452204] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 786.452204] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8556daf1-d4ef-4180-9014-ea500a9223db with Priority: HIGHEST for action port [ 786.452204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.452204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.452204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.452204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.452204] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.452204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.452699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.452699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.452699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.452699] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.452866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.452866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.452960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.453059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.453148] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.453937] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-8556daf1-d4ef-4180-9014-ea500a9223db taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.454050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8556daf1-d4ef-4180-9014-ea500a9223db" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.454121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8556daf1-d4ef-4180-9014-ea500a9223db" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.454268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8556daf1-d4ef-4180-9014-ea500a9223db" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.454340] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8556daf1-d4ef-4180-9014-ea500a9223db',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.952264] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 in Status: SUCCESS [ 786.952605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.952605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.952887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.953121] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.953260] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.953312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.953561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.953561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.953838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.954109] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.956493] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.956493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.956687] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.957554] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8556daf1-d4ef-4180-9014-ea500a9223db with status ACTIVE [ 786.957751] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.957849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.958008] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.958130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.958195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.958418] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.958519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.958519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.958717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.958717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.959034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.959034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.959034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.959215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.959269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.959362] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8556daf1-d4ef-4180-9014-ea500a9223db is going to be updated. [ 786.978477] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.978677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.978743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.978920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.979104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.979247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8556daf1-d4ef-4180-9014-ea500a9223db" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.461992] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.463595] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.758238] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 in Status: SUCCESS [ 787.758457] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 deletion is rescheduled due to dependency. [ 787.758573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.967019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.967019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.967019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.967019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.967019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.967019] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be created. [ 787.969050] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af922b11-ba63-48cf-97cd-b04487c3e7f1: rpc.has_security_group_logging(os_id): False [ 787.988531] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.988755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.989107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.989587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.990040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.990040] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.990248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.990426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.990725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.990859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.990990] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 is going to be created. [ 788.000069] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.000171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.000261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.000429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.000607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.008763] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: UNINITIALIZED for 2s [ 788.048889] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.049249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.049470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.049736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.049930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.063751] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 in Status: IN_PROGRESS for 2s [ 788.192075] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 788.192075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.152273] env[69777]: INFO networking_nsxv3.common.synchronization [req-75b95e12-13ce-4d6d-b0e3-1c6785a9caa5 req-475e3eff-2c9c-4110-a906-a895e4467cad tempest-ServersTestJSON-413471657 tempest-ServersTestJSON-413471657-project-member] Enqueued Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_members [ 789.152963] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGHEST for action security_group_members [ 789.153487] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f2530c-f805-4944-9fb5-070cda7bf623 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.153653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.154512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.154868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.154976] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.155133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.155215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.155412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.155513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.155612] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.661530] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.661692] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.661773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.662045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.662145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.662346] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.662447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.662502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.662662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.662753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.662812] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f2530c-f805-4944-9fb5-070cda7bf623 is going to be updated. [ 789.697305] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.697532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.697605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.697881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.697951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.706399] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f2530c-f805-4944-9fb5-070cda7bf623 in Status: IN_PROGRESS for 2s [ 790.018425] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 790.018785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.019027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.019339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.019621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.019811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.019907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.020162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.020282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.020412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.021300] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.075637] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 in Status: SUCCESS [ 790.075637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.127225] env[69777]: INFO networking_nsxv3.common.synchronization [req-773161ec-fa59-4e5d-9748-68be4cf027e6 req-0f9aa033-328f-42e0-ae59-812b2eee8272 tempest-ListImageFiltersTestJSON-2080667869 tempest-ListImageFiltersTestJSON-2080667869-project-member] Enqueued Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 790.127225] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 790.127536] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.127595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.127666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.128290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.129232] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.129232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.129232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.129232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.129232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.129232] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.525186] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.525486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.525486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.525701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.525898] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.526194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.526263] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.526579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.526688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.526787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.527039] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.527128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.527193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.527399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.527578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.527674] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.527737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.527882] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.527958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.528056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.528146] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.630703] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.031631] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da769e28-4f40-46a8-9dbb-f476563409e0: rpc.has_security_group_logging(os_id): False [ 791.048840] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.049313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.049313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.049313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.049480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.049577] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.050368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.050368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.050368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.050368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.050368] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.050368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.050368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.050693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.050693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.050787] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.050835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.050884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.051084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.051126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.051202] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be created. [ 791.116343] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.116500] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.116586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.117065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.117065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.127848] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 791.133559] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.637840] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.638166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.638166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.638411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.638411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.638541] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 is going to be updated. [ 791.672327] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.672327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.672327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.672327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.672327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.680217] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: IN_PROGRESS for 2s [ 791.717459] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f2530c-f805-4944-9fb5-070cda7bf623 in Status: SUCCESS [ 791.717459] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f2530c-f805-4944-9fb5-070cda7bf623 deletion is rescheduled due to dependency. [ 791.717459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.479689] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f439f28-969e-4f59-a6c3-e1045a881e65 req-6af23008-ebe7-47df-b104-45509735480b tempest-MultipleCreateTestJSON-2061516794 tempest-MultipleCreateTestJSON-2061516794-project-member] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 792.480300] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 792.480614] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.480729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.480792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.480993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.481332] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.481470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.481558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.481747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.481862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.481978] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.544548] env[69777]: INFO networking_nsxv3.common.synchronization [req-021c2091-a053-4988-bc88-187894db3a85 req-7362372d-7f15-4e6f-8f90-9cb254641a93 tempest-ListServerFiltersTestJSON-475682025 tempest-ListServerFiltersTestJSON-475682025-project-member] Enqueued Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 792.545472] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ece09a-8f35-4152-a654-20e3b05650f5 with Priority: HIGHEST for action security_group_members [ 792.545472] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54ece09a-8f35-4152-a654-20e3b05650f5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.545676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.545712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.545936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.547649] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.547649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.547649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.547649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.547649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.547649] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54ece09a-8f35-4152-a654-20e3b05650f5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.966184] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.966569] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.966569] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.967028] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.967384] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.967564] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.967907] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.968223] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.968628] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.968628] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.968746] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.968883] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.968958] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.968999] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.969130] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.969269] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.987524] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.989454] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.989628] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 792.989780] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.989957] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.992958] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-8c5a473d-9d86-46a2-b0c8-a572013a8b94 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.992958] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-8c5a473d-9d86-46a2-b0c8-a572013a8b94" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.992958] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-8c5a473d-9d86-46a2-b0c8-a572013a8b94" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.993325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-8c5a473d-9d86-46a2-b0c8-a572013a8b94" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.993979] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5a473d-9d86-46a2-b0c8-a572013a8b94',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.052533] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.052777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.052841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.053042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.053288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.053508] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.053637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.053692] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.053876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.053961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.054070] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 is going to be updated. [ 793.084738] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.084889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.085027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.085191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.085364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.095277] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: IN_PROGRESS for 2s [ 793.138478] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 793.138736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.496399] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.497675] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.497889] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.498059] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.498549] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.498549] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.498692] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 8c5a473d-9d86-46a2-b0c8-a572013a8b94 not found, creating... [ 793.498915] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.499094] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.499215] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.499438] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.499578] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.499906] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.500105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.500233] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.500452] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.500598] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.500744] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 8c5a473d-9d86-46a2-b0c8-a572013a8b94 is going to be created. [ 793.520985] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.521398] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.521637] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.521989] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.523042] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.523042] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-8c5a473d-9d86-46a2-b0c8-a572013a8b94" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.689998] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: IN_PROGRESS for 4s [ 794.003189] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.003504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.003504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.003676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.003718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.005607] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 794.037539] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.037785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.037898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.038232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.038486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.047237] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 794.431125] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f439f28-969e-4f59-a6c3-e1045a881e65 req-12224e64-c08e-43b1-b67b-76b90a766877 service nova] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_rules [ 794.431388] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f439f28-969e-4f59-a6c3-e1045a881e65 req-12224e64-c08e-43b1-b67b-76b90a766877 service nova] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 794.431526] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f439f28-969e-4f59-a6c3-e1045a881e65 req-12224e64-c08e-43b1-b67b-76b90a766877 service nova] Enqueued Resource ID: 8c5a473d-9d86-46a2-b0c8-a572013a8b94 with Priority: HIGHEST for action port [ 794.432076] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_rules [ 794.432213] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 794.432341] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5a473d-9d86-46a2-b0c8-a572013a8b94 with Priority: HIGHEST for action port [ 794.432614] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.432763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.432840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.433067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.433150] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.437014] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.437014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.437014] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c5a473d-9d86-46a2-b0c8-a572013a8b94 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.437014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c5a473d-9d86-46a2-b0c8-a572013a8b94" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.437014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c5a473d-9d86-46a2-b0c8-a572013a8b94" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.437014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c5a473d-9d86-46a2-b0c8-a572013a8b94" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.437014] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5a473d-9d86-46a2-b0c8-a572013a8b94',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.937243] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.937512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.937723] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c5a473d-9d86-46a2-b0c8-a572013a8b94 with status ACTIVE [ 794.937898] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.938019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.938094] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.938351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.938551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.938778] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.938880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.938933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.939147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.939284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.939542] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.939633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.939779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.939811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.939893] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.939939] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c5a473d-9d86-46a2-b0c8-a572013a8b94 is going to be updated. [ 794.961203] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.961795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.961795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.961795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.961955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.962566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c5a473d-9d86-46a2-b0c8-a572013a8b94" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.113036] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54ece09a-8f35-4152-a654-20e3b05650f5 in Status: SUCCESS [ 795.113489] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54ece09a-8f35-4152-a654-20e3b05650f5 deletion is rescheduled due to dependency. [ 795.113489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54ece09a-8f35-4152-a654-20e3b05650f5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.701181] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: SUCCESS [ 795.701440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.056772] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 796.057020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.057204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.058035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.058035] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.058416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.058416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.058688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.058688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.058688] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.565305] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.066727] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.570217] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.570217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.570217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.570217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.570217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.570217] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 797.599418] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.599574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.599652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.599878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.600047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.607573] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 799.433520] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 799.434097] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 799.618057] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 799.618294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.618479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.618718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.618913] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.619040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.619118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.619272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.619354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.619485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.619534] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.122071] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.122265] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.122336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.122557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.122722] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.122819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.122881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.123061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.123186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.123314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.123381] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.123507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.123617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.123682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.123791] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.123901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.123960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.124112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.124184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.124259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.124346] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.629748] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da769e28-4f40-46a8-9dbb-f476563409e0: rpc.has_security_group_logging(os_id): False [ 800.647731] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.647731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.647731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.648109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.648235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.648540] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.648734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.648803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.648964] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.649080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.649330] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.649457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.649542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.649728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.649827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.650073] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.650203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.650287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.650472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.650572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.650687] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 800.723229] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.723425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.723469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.723687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.723831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.734895] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 802.747706] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 802.748684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.652040] env[69777]: INFO networking_nsxv3.common.synchronization [None req-e2bc981c-107a-481c-b0b6-fa1c7529271d tempest-ServerRescueNegativeTestJSON-1534204294 tempest-ServerRescueNegativeTestJSON-1534204294-project-member] Enqueued Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_rules [ 803.652572] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_rules [ 803.652869] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.652988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.653072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.653681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.653842] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.756361] env[69777]: INFO networking_nsxv3.common.synchronization [None req-030560e5-be7a-4ed0-907a-9c72695ac593 tempest-ServerRescueNegativeTestJSON-1534204294 tempest-ServerRescueNegativeTestJSON-1534204294-project-member] Enqueued Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_rules [ 803.756900] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_rules [ 803.757220] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.757325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.179686] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.179686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.179686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.179686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.179686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.180187] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 already deleted. [ 804.180187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.180187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.180187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.180187] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.638672] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c07a940-27bd-4c8b-92d3-7a0d754665c7 req-5def25e9-64fb-4591-9c42-95d8d47e18d2 tempest-FloatingIPsAssociationTestJSON-955441248 tempest-FloatingIPsAssociationTestJSON-955441248-project-member] Enqueued Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 804.639161] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 804.639440] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.639568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.639632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.639883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.640046] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.640140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.640202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.641153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.641153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.641153] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.700235] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.700235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.700235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.700235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.700235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.700235] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 already deleted. [ 804.700573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.121166] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-474 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.121476] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.121583] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.122052] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.122139] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.122252] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.123700] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.123700] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.123700] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.123700] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.123700] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.123700] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.123700] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.123700] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.123700] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.123700] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.143110] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.143110] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.143110] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.143110] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.143110] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-a3a1854f-9557-46ad-8578-925ce6573cb4 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.143543] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-a3a1854f-9557-46ad-8578-925ce6573cb4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.143543] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-a3a1854f-9557-46ad-8578-925ce6573cb4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.144305] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-a3a1854f-9557-46ad-8578-925ce6573cb4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.144638] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3a1854f-9557-46ad-8578-925ce6573cb4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.145774] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.145774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.145774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.145965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.146204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.146204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.146328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.146328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.146465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.146544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.146627] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 already deleted. [ 805.146708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.649033] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.649281] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.649404] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.649662] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.649847] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.650021] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port a3a1854f-9557-46ad-8578-925ce6573cb4 not found, creating... [ 805.650305] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.650433] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.650554] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.650781] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.650918] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.651210] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.651365] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.651482] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.651763] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.651946] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.652282] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: a3a1854f-9557-46ad-8578-925ce6573cb4 is going to be created. [ 805.672686] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.672913] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.673048] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.673336] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.673599] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.673882] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-a3a1854f-9557-46ad-8578-925ce6573cb4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.264858] env[69777]: INFO networking_nsxv3.common.synchronization [req-136d0f97-f1b7-414c-b766-d37add8ab2ae req-275b37ea-0e00-48aa-8ec7-7fe8b66a6a6a tempest-MultipleCreateTestJSON-2061516794 tempest-MultipleCreateTestJSON-2061516794-project-member] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 806.266672] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 806.266672] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.266672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.266672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.266672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.266672] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.266672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.266672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.266672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.266672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.266672] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.435988] env[69777]: INFO networking_nsxv3.common.synchronization [req-1b3520ae-049b-4000-bcaf-e17aac565327 req-c3219e21-8693-4c36-85e7-fe1b277f77a0 tempest-MultipleCreateTestJSON-2061516794 tempest-MultipleCreateTestJSON-2061516794-project-member] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 806.436916] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 806.436916] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.437057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.483212] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c07a940-27bd-4c8b-92d3-7a0d754665c7 req-d0bd9b80-7c98-4069-8618-be16523bad9a service nova] Enqueued Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_rules [ 806.483397] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c07a940-27bd-4c8b-92d3-7a0d754665c7 req-d0bd9b80-7c98-4069-8618-be16523bad9a service nova] Enqueued Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 806.483536] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c07a940-27bd-4c8b-92d3-7a0d754665c7 req-d0bd9b80-7c98-4069-8618-be16523bad9a service nova] Enqueued Resource ID: a3a1854f-9557-46ad-8578-925ce6573cb4 with Priority: HIGHEST for action port [ 806.484102] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_rules [ 806.484102] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 806.484102] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3a1854f-9557-46ad-8578-925ce6573cb4 with Priority: HIGHEST for action port [ 806.484484] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.484609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.484677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.485145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.485269] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.486239] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.486392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.486429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.486628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.486867] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.486917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.486992] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.487156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.487348] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.487465] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.488301] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3a1854f-9557-46ad-8578-925ce6573cb4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.488433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3a1854f-9557-46ad-8578-925ce6573cb4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.488519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3a1854f-9557-46ad-8578-925ce6573cb4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.488697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3a1854f-9557-46ad-8578-925ce6573cb4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.488851] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3a1854f-9557-46ad-8578-925ce6573cb4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.769225] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.991188] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.992099] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.992158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.993368] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3a1854f-9557-46ad-8578-925ce6573cb4 with status ACTIVE [ 806.993549] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.993685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.993730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.993922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.994015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.994176] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.996162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.996162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.996162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.996162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.996162] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.996162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.996162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.996162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.996162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.996162] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3a1854f-9557-46ad-8578-925ce6573cb4 is going to be updated. [ 807.014350] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.014511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.014573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.015060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.015060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.015060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3a1854f-9557-46ad-8578-925ce6573cb4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.271760] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.410930] env[69777]: INFO networking_nsxv3.common.synchronization [req-00032439-8e25-45b2-bc38-d7bfbf7f17db req-ecb9d7f0-7e92-4df6-bb6d-9b04c821c3ff tempest-ImagesTestJSON-42450789 tempest-ImagesTestJSON-42450789-project-member] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 807.411591] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 807.411730] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.411857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.411927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.412176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.412280] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.412404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.412438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.412608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.412648] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.413018] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.497584] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.767016] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.767248] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.767377] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.767674] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.767934] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.768397] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.768552] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.768788] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.768955] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.769154] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.769270] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.769406] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.769520] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.769641] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.769789] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.769975] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.771797] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.771913] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.771983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.772207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.772246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.772312] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 807.796894] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.797070] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.797214] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.797387] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.797769] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-a5983d0b-f2fc-422f-aba9-36d5258bbe04 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.797971] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-a5983d0b-f2fc-422f-aba9-36d5258bbe04" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.798067] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-a5983d0b-f2fc-422f-aba9-36d5258bbe04" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.798371] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-a5983d0b-f2fc-422f-aba9-36d5258bbe04" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.798505] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5983d0b-f2fc-422f-aba9-36d5258bbe04',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.822707] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.822850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.822922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.823134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.823272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.830832] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 807.915104] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.915371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.915433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.915803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.915924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.916196] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.916319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.916398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.916607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.916699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.916793] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 807.941297] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.941466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.941514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.941724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.941879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.952739] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 808.006387] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.006548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.006614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.006834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.006928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.007037] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 is going to be created. [ 808.030665] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.030841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.030916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.031642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.031880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.040491] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: UNINITIALIZED for 2s [ 808.300920] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.301262] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.301308] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.301555] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.301705] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.301865] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port a5983d0b-f2fc-422f-aba9-36d5258bbe04 not found, creating... [ 808.305261] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.305261] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.305261] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.305512] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.305636] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.307556] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.307556] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.307556] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.307556] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.307556] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.307556] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: a5983d0b-f2fc-422f-aba9-36d5258bbe04 is going to be created. [ 808.327731] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.327994] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.328138] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.328426] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.328663] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.328886] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-a5983d0b-f2fc-422f-aba9-36d5258bbe04" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.038757] env[69777]: INFO networking_nsxv3.common.synchronization [req-00032439-8e25-45b2-bc38-d7bfbf7f17db req-8fe02a74-e135-489b-81ca-fb2fc75d3350 service nova] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_rules [ 809.038993] env[69777]: INFO networking_nsxv3.common.synchronization [req-00032439-8e25-45b2-bc38-d7bfbf7f17db req-8fe02a74-e135-489b-81ca-fb2fc75d3350 service nova] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 809.039165] env[69777]: INFO networking_nsxv3.common.synchronization [req-00032439-8e25-45b2-bc38-d7bfbf7f17db req-8fe02a74-e135-489b-81ca-fb2fc75d3350 service nova] Enqueued Resource ID: a5983d0b-f2fc-422f-aba9-36d5258bbe04 with Priority: HIGHEST for action port [ 809.039680] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_rules [ 809.039815] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 809.039978] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5983d0b-f2fc-422f-aba9-36d5258bbe04 with Priority: HIGHEST for action port [ 809.040268] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.040389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.040455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.040788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.040788] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.042529] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.042651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.042825] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5983d0b-f2fc-422f-aba9-36d5258bbe04 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.042928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5983d0b-f2fc-422f-aba9-36d5258bbe04" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.042990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5983d0b-f2fc-422f-aba9-36d5258bbe04" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.043180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5983d0b-f2fc-422f-aba9-36d5258bbe04" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.043257] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5983d0b-f2fc-422f-aba9-36d5258bbe04',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.543097] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.543394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.544849] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5983d0b-f2fc-422f-aba9-36d5258bbe04 with status ACTIVE [ 809.544849] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.544943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.544977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.545178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.545269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.545432] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.545529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.546138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.546138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.546138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.546138] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.546138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.546343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.546343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.546423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.546461] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5983d0b-f2fc-422f-aba9-36d5258bbe04 is going to be updated. [ 809.565522] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.565668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.565744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.565913] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.566064] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.566228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5983d0b-f2fc-422f-aba9-36d5258bbe04" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.840517] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 809.840702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.840870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.841110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.841296] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.841412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.841480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.841634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.841718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.841813] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.926654] env[69777]: INFO networking_nsxv3.common.synchronization [req-f6fd5992-32d0-4d77-89e4-35c5c7e10919 req-b85ad489-3fc5-4fcc-91cb-a3875aa44d39 tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 809.927209] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 809.927504] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.927664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.927733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.927983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.928258] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.928363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.928448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.928629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.928721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.928815] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.960953] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 809.961157] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 deletion is rescheduled due to dependency. [ 809.961538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.961538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.961686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.962139] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.962139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.962139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.962139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.962327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.962327] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.050631] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: SUCCESS [ 810.050850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.051019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.051232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.051416] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.051534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.051612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.051739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.051879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.051972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.052078] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.269108] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.269270] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.269371] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.269694] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.270442] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.270610] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.270733] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.270954] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.271116] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.271361] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 810.271432] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.271542] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.271649] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.271957] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 810.272109] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.272245] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.290022] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.290181] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 810.290320] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.290613] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.290911] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-2b06ac32-fff4-4089-a9a3-2fb11a710dee taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.291179] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-2b06ac32-fff4-4089-a9a3-2fb11a710dee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.291269] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-2b06ac32-fff4-4089-a9a3-2fb11a710dee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.291492] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-2b06ac32-fff4-4089-a9a3-2fb11a710dee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.291630] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b06ac32-fff4-4089-a9a3-2fb11a710dee',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.343597] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.343757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.343838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.344046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.344139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.344346] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.344450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.344507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.344661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.344800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.344852] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 810.376588] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.376721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.378147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.378147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.378147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.385478] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 810.431799] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.431974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.432058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.432242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.432336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.432555] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.432641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.432696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.432816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.432895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.432971] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 already deleted. [ 810.433072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.466998] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.554464] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.554752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.554752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.555413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.555413] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.555413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.555413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.555676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.555710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.556333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.556333] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.556333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.556333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.556333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.556671] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.556671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.556671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.556671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.556843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.556843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.556909] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.793412] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.793654] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.793856] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.794293] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.794463] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.794695] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 2b06ac32-fff4-4089-a9a3-2fb11a710dee not found, creating... [ 810.795086] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.795327] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.795517] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.795846] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.796183] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.796496] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.796734] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.796927] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.797326] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.797459] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.797682] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 2b06ac32-fff4-4089-a9a3-2fb11a710dee is going to be created. [ 810.819367] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.819644] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.820083] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.820455] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.820781] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.821106] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-2b06ac32-fff4-4089-a9a3-2fb11a710dee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.970375] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.064593] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf27a656-ea7d-4a2d-b6f9-fe71cbf46653: rpc.has_security_group_logging(os_id): False [ 811.083018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.083018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.083018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.083018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.083629] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.083629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.083629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.083629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.083629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.083629] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 is going to be created. [ 811.146303] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.146303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.146303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.146303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.146303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.159177] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: IN_PROGRESS for 2s [ 811.472368] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.472534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.472623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.472906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.473077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.473210] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 811.500040] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.500203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.500276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.500621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.500621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.508617] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 811.811026] env[69777]: INFO networking_nsxv3.common.synchronization [req-f6fd5992-32d0-4d77-89e4-35c5c7e10919 req-88474dae-2dcc-4595-b68e-835a52762fbf service nova] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_rules [ 811.811026] env[69777]: INFO networking_nsxv3.common.synchronization [req-f6fd5992-32d0-4d77-89e4-35c5c7e10919 req-88474dae-2dcc-4595-b68e-835a52762fbf service nova] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 811.811026] env[69777]: INFO networking_nsxv3.common.synchronization [req-f6fd5992-32d0-4d77-89e4-35c5c7e10919 req-88474dae-2dcc-4595-b68e-835a52762fbf service nova] Enqueued Resource ID: 2b06ac32-fff4-4089-a9a3-2fb11a710dee with Priority: HIGHEST for action port [ 811.811026] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_rules [ 811.811026] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 811.811026] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b06ac32-fff4-4089-a9a3-2fb11a710dee with Priority: HIGHEST for action port [ 811.811026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.811026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.811026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.812549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.813189] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.813655] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.813807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.813878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.814065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.814214] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.814307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.814360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.814498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.814577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.816844] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.816844] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b06ac32-fff4-4089-a9a3-2fb11a710dee taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.816844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b06ac32-fff4-4089-a9a3-2fb11a710dee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.816844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b06ac32-fff4-4089-a9a3-2fb11a710dee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.816844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b06ac32-fff4-4089-a9a3-2fb11a710dee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.816844] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b06ac32-fff4-4089-a9a3-2fb11a710dee',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.318026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.318026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.319297] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b06ac32-fff4-4089-a9a3-2fb11a710dee with status ACTIVE [ 812.319819] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.319819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.319819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.320054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.320054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.320175] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.320823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.320823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.320823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.320823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.321015] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.321137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.321177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.321359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.321472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.321579] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b06ac32-fff4-4089-a9a3-2fb11a710dee is going to be updated. [ 812.322837] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.343507] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.343651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.343724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.343935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.344085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.344243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b06ac32-fff4-4089-a9a3-2fb11a710dee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.399402] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 812.399668] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 deletion is rescheduled due to dependency. [ 812.399736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.599119] env[69777]: INFO networking_nsxv3.common.synchronization [req-299b6285-58b0-4aff-b6b5-b340cbd96266 req-5d823656-11e0-4563-b40f-3955ec89c644 tempest-VolumesAdminNegativeTest-1280332786 tempest-VolumesAdminNegativeTest-1280332786-project-member] Enqueued Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_members [ 812.599119] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_members [ 812.599119] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-df000c73-dfce-4f6a-a3af-75deec8fae28 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.599119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.599119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.599119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.599119] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.599119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.599119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.599119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.599119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.599119] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.825526] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.042485] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.042683] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-944" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.042811] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-944" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.043146] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-944" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.043406] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.043562] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.043680] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.043899] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.044241] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.044708] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.044881] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.045020] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.045137] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.045255] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.045365] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.045498] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.070764] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.070931] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 813.071089] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.071274] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-944" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.071581] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-68005c26-0517-4360-857d-2290dc04b591 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.071753] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-68005c26-0517-4360-857d-2290dc04b591" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.071873] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-68005c26-0517-4360-857d-2290dc04b591" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.072226] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-68005c26-0517-4360-857d-2290dc04b591" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.072367] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68005c26-0517-4360-857d-2290dc04b591',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.102854] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.103012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.103089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.103321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.103414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.103621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.103733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.103794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.103956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.104044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.104131] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df000c73-dfce-4f6a-a3af-75deec8fae28 already deleted. [ 813.104213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.172972] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: SUCCESS [ 813.173302] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.328832] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.329048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.329140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.329315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.329400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.329500] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be created. [ 813.353246] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.353394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.353457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.355061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.355061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.362820] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: UNINITIALIZED for 2s [ 813.519859] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 813.520093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.520264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.520478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.520668] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.520792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.520888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.521062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.521145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.521231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.521323] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.576822] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.577105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.577235] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.577504] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.577682] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.577852] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 68005c26-0517-4360-857d-2290dc04b591 not found, creating... [ 813.578127] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.578283] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.578401] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.578619] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.578803] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.579136] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.579297] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.579415] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.579621] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.579756] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.579925] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 68005c26-0517-4360-857d-2290dc04b591 is going to be created. [ 813.599273] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.599481] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.599607] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.599881] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.600122] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.600344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-68005c26-0517-4360-857d-2290dc04b591" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.027944] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.027944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.028270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.028270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.028397] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.028466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.028536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.028661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.028745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.028829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.028967] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.029067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.029125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.029505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.030105] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.030105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.030105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.030105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.030105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.030105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.030378] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.399894] env[69777]: INFO networking_nsxv3.common.synchronization [req-299b6285-58b0-4aff-b6b5-b340cbd96266 req-e7359a43-22af-4e37-9e62-c3278b15199c service nova] Enqueued Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_rules [ 814.400138] env[69777]: INFO networking_nsxv3.common.synchronization [req-299b6285-58b0-4aff-b6b5-b340cbd96266 req-e7359a43-22af-4e37-9e62-c3278b15199c service nova] Enqueued Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_members [ 814.400293] env[69777]: INFO networking_nsxv3.common.synchronization [req-299b6285-58b0-4aff-b6b5-b340cbd96266 req-e7359a43-22af-4e37-9e62-c3278b15199c service nova] Enqueued Resource ID: 68005c26-0517-4360-857d-2290dc04b591 with Priority: HIGHEST for action port [ 814.400548] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_rules [ 814.400683] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_members [ 814.400785] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68005c26-0517-4360-857d-2290dc04b591 with Priority: HIGHEST for action port [ 814.403733] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df000c73-dfce-4f6a-a3af-75deec8fae28 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.404133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.404223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.404397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.404486] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.409208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-df000c73-dfce-4f6a-a3af-75deec8fae28 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.409208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.409208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.409208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.409208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.409208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.409208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.409600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.409694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.409784] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.411324] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-68005c26-0517-4360-857d-2290dc04b591 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.411324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68005c26-0517-4360-857d-2290dc04b591" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.411324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68005c26-0517-4360-857d-2290dc04b591" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.411324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68005c26-0517-4360-857d-2290dc04b591" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.411324] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68005c26-0517-4360-857d-2290dc04b591',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.532016] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c31a3d66-3f9b-4509-bdc2-763f23333743: rpc.has_security_group_logging(os_id): False [ 814.548854] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.549043] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.549119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.549339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.549433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.550028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.550028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.550028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.550028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.550274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.550311] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.550410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.550484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.550629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.550722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.550926] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.551928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.552079] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.552202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.552290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.552369] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 814.629346] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.629523] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.629590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.629777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.629928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.640897] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 814.913398] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.917050] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-df000c73-dfce-4f6a-a3af-75deec8fae28 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.917216] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.920025] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68005c26-0517-4360-857d-2290dc04b591 with status ACTIVE [ 814.920025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.920025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.920025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.920025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.922951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.923106] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68005c26-0517-4360-857d-2290dc04b591 is going to be updated. [ 814.959711] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.959973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.960079] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.960241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.960383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.960552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68005c26-0517-4360-857d-2290dc04b591" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.374788] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 815.375120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.375120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.375370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.375468] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.375656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.376027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.376148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.376284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.376424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.376568] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.425661] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.434517] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a3b070a3-3413-428a-b9de-17ed40888bba None None] Enqueued Resource ID: 18eb25f6-02fd-4b32-a2d4-a85b358e35c9 with Priority: HIGHEST for action port [ 815.435297] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18eb25f6-02fd-4b32-a2d4-a85b358e35c9 with Priority: HIGHEST for action port [ 815.435694] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-18eb25f6-02fd-4b32-a2d4-a85b358e35c9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.435809] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18eb25f6-02fd-4b32-a2d4-a85b358e35c9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.435876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18eb25f6-02fd-4b32-a2d4-a85b358e35c9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.436486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18eb25f6-02fd-4b32-a2d4-a85b358e35c9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.436667] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18eb25f6-02fd-4b32-a2d4-a85b358e35c9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.885354] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.885627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.885627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.885910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.886173] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.886173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.886338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.886376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.886466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.886554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.886699] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.886791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.886850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.886990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.887183] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.887294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.887294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.887440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.887637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.887637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.887751] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.930353] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.930588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.930681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.930966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.931179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.931274] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df000c73-dfce-4f6a-a3af-75deec8fae28 is going to be created. [ 815.942447] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18eb25f6-02fd-4b32-a2d4-a85b358e35c9 [ 815.942963] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.942963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.942963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.943261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.943431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.943531] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18eb25f6-02fd-4b32-a2d4-a85b358e35c9 already deleted. [ 815.943578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18eb25f6-02fd-4b32-a2d4-a85b358e35c9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.957483] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.957803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.957803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.958367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.958367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.969527] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df000c73-dfce-4f6a-a3af-75deec8fae28 in Status: UNINITIALIZED for 2s [ 816.391128] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2102ed9-efb2-4a2c-a170-b1e7872f4215: rpc.has_security_group_logging(os_id): False [ 816.409389] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.409522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.409592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.410532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.410532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.410532] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.410532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.410532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.410532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.410532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.410874] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.410874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.410874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.411138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.411138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.411208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.411262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.411327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.411463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.411540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.411624] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be created. [ 816.471343] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.471343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.471343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.471343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.471343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.487227] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 816.552207] env[69777]: INFO networking_nsxv3.common.synchronization [req-8120cee5-2e6a-4e62-80b2-c068d07f5ffd req-dbd29757-f172-4471-b445-fb146a54f06f tempest-ServersAdminNegativeTestJSON-1845497165 tempest-ServersAdminNegativeTestJSON-1845497165-project-member] Enqueued Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 816.552745] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 816.553060] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.553217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.553287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.553442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.553587] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.554296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.554296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.554296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.554296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.554557] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.657948] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 816.658196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.963241] env[69777]: INFO networking_nsxv3.common.synchronization [None req-e5268853-39aa-4e11-9c89-547ea07abd64 tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_rules [ 816.963836] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_rules [ 816.964187] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.964316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.964383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.964945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.965061] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.059969] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.122161] env[69777]: INFO networking_nsxv3.common.synchronization [None req-065e82b9-6294-446d-ad47-eae4a1ed718b tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_rules [ 817.122161] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_rules [ 817.122161] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.122161] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.142399] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.142598] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.142733] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.143194] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.143508] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.143703] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.143844] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.144110] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.144298] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.144547] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 817.144764] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.144855] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.145043] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.145197] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 817.145395] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.145578] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.163761] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.163959] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 817.164174] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.164323] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.164584] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-78f702f9-f90f-4506-9c55-8d9a2991ad2f taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.165257] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-78f702f9-f90f-4506-9c55-8d9a2991ad2f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.165496] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-78f702f9-f90f-4506-9c55-8d9a2991ad2f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.165766] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-78f702f9-f90f-4506-9c55-8d9a2991ad2f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.166064] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78f702f9-f90f-4506-9c55-8d9a2991ad2f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.486742] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.487116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.487116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.487193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.487292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.487362] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 already deleted. [ 817.487444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.487593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.487771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.487855] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.564767] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.669828] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.670136] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.670332] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.670846] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.671074] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.671300] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 78f702f9-f90f-4506-9c55-8d9a2991ad2f not found, creating... [ 817.671632] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.672459] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.672650] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.672921] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.673118] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.673466] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.677014] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.677014] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.677014] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.677014] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.677014] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 78f702f9-f90f-4506-9c55-8d9a2991ad2f is going to be created. [ 817.694494] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.694690] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.694819] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.695099] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.695330] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.695548] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-78f702f9-f90f-4506-9c55-8d9a2991ad2f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.978960] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df000c73-dfce-4f6a-a3af-75deec8fae28 in Status: SUCCESS [ 817.979255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.979442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.979655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.979971] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.980082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.980082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.980257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.980377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.980433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.980567] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.007383] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.007865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.007865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.008341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.008341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.008472] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 already deleted. [ 818.008610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.072919] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.072919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.072919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.072919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.072919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.072919] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 is going to be updated. [ 818.104900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.104900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.104900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.104900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.104900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.110842] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: IN_PROGRESS for 2s [ 818.153631] env[69777]: INFO networking_nsxv3.common.synchronization [None req-3cda7950-ecd0-4676-b61f-341932fb876e None None] Enqueued Resource ID: d68d1227-8cf8-45d9-977b-8b44b27b43e4 with Priority: HIGHEST for action port [ 818.154436] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d68d1227-8cf8-45d9-977b-8b44b27b43e4 with Priority: HIGHEST for action port [ 818.155420] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d68d1227-8cf8-45d9-977b-8b44b27b43e4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.155622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d68d1227-8cf8-45d9-977b-8b44b27b43e4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.155704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d68d1227-8cf8-45d9-977b-8b44b27b43e4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.155966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d68d1227-8cf8-45d9-977b-8b44b27b43e4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.156072] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d68d1227-8cf8-45d9-977b-8b44b27b43e4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.485202] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.499346] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 818.499346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.658080] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d68d1227-8cf8-45d9-977b-8b44b27b43e4 [ 818.658308] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.658454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.658528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.658789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.658884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.658929] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d68d1227-8cf8-45d9-977b-8b44b27b43e4 already deleted. [ 818.659030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d68d1227-8cf8-45d9-977b-8b44b27b43e4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.812782] env[69777]: INFO networking_nsxv3.common.synchronization [req-8120cee5-2e6a-4e62-80b2-c068d07f5ffd req-7a151e68-7311-4e92-811d-3fed5ff4220c service nova] Enqueued Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_rules [ 818.813012] env[69777]: INFO networking_nsxv3.common.synchronization [req-8120cee5-2e6a-4e62-80b2-c068d07f5ffd req-7a151e68-7311-4e92-811d-3fed5ff4220c service nova] Enqueued Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 818.813132] env[69777]: INFO networking_nsxv3.common.synchronization [req-8120cee5-2e6a-4e62-80b2-c068d07f5ffd req-7a151e68-7311-4e92-811d-3fed5ff4220c service nova] Enqueued Resource ID: 78f702f9-f90f-4506-9c55-8d9a2991ad2f with Priority: HIGHEST for action port [ 818.813371] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_rules [ 818.813496] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 818.813589] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f702f9-f90f-4506-9c55-8d9a2991ad2f with Priority: HIGHEST for action port [ 818.816347] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.816418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.816931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.817196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.818385] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.821723] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.822829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.823133] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-78f702f9-f90f-4506-9c55-8d9a2991ad2f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.823244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78f702f9-f90f-4506-9c55-8d9a2991ad2f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.823311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78f702f9-f90f-4506-9c55-8d9a2991ad2f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.823588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78f702f9-f90f-4506-9c55-8d9a2991ad2f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.823709] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78f702f9-f90f-4506-9c55-8d9a2991ad2f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.990463] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df000c73-dfce-4f6a-a3af-75deec8fae28: rpc.has_security_group_logging(os_id): False [ 819.009687] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.009687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.009687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.009687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.010083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.010083] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.010083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.010238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.010273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.010350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.010465] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df000c73-dfce-4f6a-a3af-75deec8fae28 is going to be created. [ 819.070154] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.070332] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.070428] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.070648] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.070836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.088146] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df000c73-dfce-4f6a-a3af-75deec8fae28 in Status: IN_PROGRESS for 2s [ 819.327295] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78f702f9-f90f-4506-9c55-8d9a2991ad2f with status ACTIVE [ 819.327464] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.327525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.327560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.327891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.327947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.331606] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.331752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.331829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.332053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.332119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.332320] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.332433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.332490] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.332619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.332697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.332816] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78f702f9-f90f-4506-9c55-8d9a2991ad2f is going to be updated. [ 819.334663] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.334778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.354862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.354983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.355031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.355269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.355607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.355607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78f702f9-f90f-4506-9c55-8d9a2991ad2f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.507125] env[69777]: INFO networking_nsxv3.common.synchronization [req-ee841e6c-e611-4751-bba7-324a586ff082 req-0e8c6cf0-8062-47af-852c-d580dd644459 tempest-ServersTestBootFromVolume-1880680884 tempest-ServersTestBootFromVolume-1880680884-project-member] Enqueued Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_members [ 819.507715] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_members [ 819.508492] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-47227221-8e24-429f-b3e4-917bd42f6a48 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.508782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.508782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.510292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.510292] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.510292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.510292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.515259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.515259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.515259] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47227221-8e24-429f-b3e4-917bd42f6a48',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.977145] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.977348] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-121" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.977474] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-121" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.977844] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-121" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.978226] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.978317] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.978502] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.978856] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.978856] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.978983] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.980825] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.980825] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.980825] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.980825] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.980997] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.981094] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.003543] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.004570] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 820.004570] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.004570] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-121" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.004570] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-ac71a964-1b85-46f6-ae70-19e64c76262e taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.005384] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-ac71a964-1b85-46f6-ae70-19e64c76262e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.005384] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-ac71a964-1b85-46f6-ae70-19e64c76262e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.005384] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-ac71a964-1b85-46f6-ae70-19e64c76262e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.005384] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac71a964-1b85-46f6-ae70-19e64c76262e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.015909] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.016127] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.018457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.018457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.018457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.018457] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.018457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.018457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.018457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.018457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.018457] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47227221-8e24-429f-b3e4-917bd42f6a48 already deleted. [ 820.018457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.120651] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: SUCCESS [ 820.120769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.120969] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.121442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.121531] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.121700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.121700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.122217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.122217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.122217] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.508034] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.508352] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.508391] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.508676] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.508881] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.509081] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port ac71a964-1b85-46f6-ae70-19e64c76262e not found, creating... [ 820.509352] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.509510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.509640] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.509868] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.510023] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.510304] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.510457] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.510575] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.510786] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.510927] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.511844] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: ac71a964-1b85-46f6-ae70-19e64c76262e is going to be created. [ 820.534701] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.537469] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.537570] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.538755] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.539048] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.539344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-ac71a964-1b85-46f6-ae70-19e64c76262e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.627157] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.098331] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df000c73-dfce-4f6a-a3af-75deec8fae28 in Status: SUCCESS [ 821.098331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.129533] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.475182] env[69777]: INFO networking_nsxv3.common.synchronization [req-ee841e6c-e611-4751-bba7-324a586ff082 req-12943e39-a300-49ba-96e9-c805c07174dd service nova] Enqueued Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_rules [ 821.475352] env[69777]: INFO networking_nsxv3.common.synchronization [req-ee841e6c-e611-4751-bba7-324a586ff082 req-12943e39-a300-49ba-96e9-c805c07174dd service nova] Enqueued Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_members [ 821.475487] env[69777]: INFO networking_nsxv3.common.synchronization [req-ee841e6c-e611-4751-bba7-324a586ff082 req-12943e39-a300-49ba-96e9-c805c07174dd service nova] Enqueued Resource ID: ac71a964-1b85-46f6-ae70-19e64c76262e with Priority: HIGHEST for action port [ 821.475721] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_rules [ 821.475875] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_members [ 821.476529] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac71a964-1b85-46f6-ae70-19e64c76262e with Priority: HIGHEST for action port [ 821.479941] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47227221-8e24-429f-b3e4-917bd42f6a48 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.479941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.479941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.479941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.479941] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47227221-8e24-429f-b3e4-917bd42f6a48',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.483742] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-47227221-8e24-429f-b3e4-917bd42f6a48 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.483742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.483742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.483742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.483742] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.483742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.483742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.483742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.483742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.484145] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47227221-8e24-429f-b3e4-917bd42f6a48',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.487209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac71a964-1b85-46f6-ae70-19e64c76262e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.487358] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac71a964-1b85-46f6-ae70-19e64c76262e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.487474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac71a964-1b85-46f6-ae70-19e64c76262e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.487756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac71a964-1b85-46f6-ae70-19e64c76262e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.487888] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac71a964-1b85-46f6-ae70-19e64c76262e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.639805] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.641219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.641219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.641219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.641219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.641219] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 is going to be updated. [ 821.682172] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.682172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.682172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.682172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.682172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.691404] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: IN_PROGRESS for 2s [ 821.989596] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-47227221-8e24-429f-b3e4-917bd42f6a48 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.989799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.989961] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47227221-8e24-429f-b3e4-917bd42f6a48',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.991096] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac71a964-1b85-46f6-ae70-19e64c76262e with status ACTIVE [ 821.991404] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.991547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.991547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.991707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.991990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.992024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.992227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.992227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.992407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.992476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.992711] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.993276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.993276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.993276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.993276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.993404] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac71a964-1b85-46f6-ae70-19e64c76262e is going to be updated. [ 822.013571] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.013723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.013808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.014217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.014217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.014350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac71a964-1b85-46f6-ae70-19e64c76262e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.151864] env[69777]: INFO networking_nsxv3.common.synchronization [None req-d1d24c89-7879-4ee0-a672-c8e3637b26bd None None] Enqueued Resource ID: b4b50eab-09d6-446a-9189-63b3179f91c4 with Priority: HIGHEST for action port [ 822.151864] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4b50eab-09d6-446a-9189-63b3179f91c4 with Priority: HIGHEST for action port [ 822.151864] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4b50eab-09d6-446a-9189-63b3179f91c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.151864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4b50eab-09d6-446a-9189-63b3179f91c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.151864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4b50eab-09d6-446a-9189-63b3179f91c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.151864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4b50eab-09d6-446a-9189-63b3179f91c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.151864] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b50eab-09d6-446a-9189-63b3179f91c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.495660] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47227221-8e24-429f-b3e4-917bd42f6a48',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.655744] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4b50eab-09d6-446a-9189-63b3179f91c4 [ 822.655973] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.655973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.656100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.656282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.656463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.656580] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4b50eab-09d6-446a-9189-63b3179f91c4 already deleted. [ 822.656678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4b50eab-09d6-446a-9189-63b3179f91c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.001132] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.001199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.001246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.001470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.001576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.001676] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47227221-8e24-429f-b3e4-917bd42f6a48 is going to be created. [ 823.025337] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.025503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.025572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.025734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.025897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.038162] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47227221-8e24-429f-b3e4-917bd42f6a48 in Status: UNINITIALIZED for 2s [ 823.707042] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: SUCCESS [ 823.707042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.707042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.707042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.707042] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.707042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.707042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.707042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.707042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.707042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.707042] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.117751] env[69777]: INFO networking_nsxv3.common.synchronization [None req-c048e1c5-0b6b-4043-9c4a-6c59e243e48b None None] Enqueued Resource ID: b4519175-f579-4f6d-9e68-cb0c878e62a2 with Priority: HIGHEST for action port [ 824.117751] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4519175-f579-4f6d-9e68-cb0c878e62a2 with Priority: HIGHEST for action port [ 824.118076] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4519175-f579-4f6d-9e68-cb0c878e62a2 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.118215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4519175-f579-4f6d-9e68-cb0c878e62a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.118281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4519175-f579-4f6d-9e68-cb0c878e62a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.118532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4519175-f579-4f6d-9e68-cb0c878e62a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.118617] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4519175-f579-4f6d-9e68-cb0c878e62a2',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.211027] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.211343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.211343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.215076] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.215076] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.215076] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.215076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.215076] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.621421] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4519175-f579-4f6d-9e68-cb0c878e62a2 [ 824.621639] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.621792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.622738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.622738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.622738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.622738] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4519175-f579-4f6d-9e68-cb0c878e62a2 already deleted. [ 824.622738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4519175-f579-4f6d-9e68-cb0c878e62a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.718823] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292: rpc.has_security_group_logging(os_id): False [ 824.738308] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.738444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.738518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.738733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.738831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.739055] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.739169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.739221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.739370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.739449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.739631] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.739721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.739785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.739923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.740045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.740194] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.740287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.740350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.740487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.740562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.740647] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 is going to be updated. [ 824.813637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.813797] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.813869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.814185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.814344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.832018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: IN_PROGRESS for 2s [ 824.986245] env[69777]: INFO networking_nsxv3.common.synchronization [req-46e42c5a-7af0-4345-b2e9-f07618cbc9b4 req-f07ede0c-2675-4916-b5a6-17b3ce807dc2 tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 824.986836] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 824.987675] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.987675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.987675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.987675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.987675] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.987675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.988154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.988154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.988154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.988154] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.047337] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47227221-8e24-429f-b3e4-917bd42f6a48 in Status: SUCCESS [ 825.047660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.047746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.048009] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.048189] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.048319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.048386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.048542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.048633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.048737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.049096] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47227221-8e24-429f-b3e4-917bd42f6a48',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.494234] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.552999] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47227221-8e24-429f-b3e4-917bd42f6a48',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.786734] env[69777]: INFO networking_nsxv3.common.synchronization [None req-b5d90966-c121-4060-957e-4d5d98279e5c None None] Enqueued Resource ID: 3f4014f1-5014-4780-a1cb-d12ca67007a2 with Priority: HIGHEST for action port [ 825.787381] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f4014f1-5014-4780-a1cb-d12ca67007a2 with Priority: HIGHEST for action port [ 825.788705] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f4014f1-5014-4780-a1cb-d12ca67007a2 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.788897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f4014f1-5014-4780-a1cb-d12ca67007a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.788969] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f4014f1-5014-4780-a1cb-d12ca67007a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.789246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f4014f1-5014-4780-a1cb-d12ca67007a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.789334] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f4014f1-5014-4780-a1cb-d12ca67007a2',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.813375] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.813597] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.813728] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.813990] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.814259] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.814412] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.814529] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.814737] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.814931] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.815106] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.815266] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.815329] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.815437] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.815545] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.815650] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.815969] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.834187] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.834362] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.834501] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.834831] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.834989] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-33bd19f4-68c9-4496-8dc7-e3cb33124b77 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.835176] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-33bd19f4-68c9-4496-8dc7-e3cb33124b77" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.835296] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-33bd19f4-68c9-4496-8dc7-e3cb33124b77" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.835626] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-33bd19f4-68c9-4496-8dc7-e3cb33124b77" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.835823] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33bd19f4-68c9-4496-8dc7-e3cb33124b77',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.998953] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.006640] env[69777]: INFO networking_nsxv3.common.synchronization [req-fb3beac1-04ff-4386-af04-134903f09fdd req-29830668-c109-417b-861c-69ba7538aff0 tempest-ListImageFiltersTestJSON-2080667869 tempest-ListImageFiltersTestJSON-2080667869-project-member] Enqueued Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 826.008914] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGHEST for action security_group_members [ 826.011312] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.012020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.012226] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.013026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.013446] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.013767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.013915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.014155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.014439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.014669] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.057355] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47227221-8e24-429f-b3e4-917bd42f6a48: rpc.has_security_group_logging(os_id): False [ 826.074970] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.074970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.074970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.074970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.074970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.075438] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.075544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.075609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.076936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.076936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.076936] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47227221-8e24-429f-b3e4-917bd42f6a48 is going to be created. [ 826.208024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.208024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.208024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.208024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.208024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.216912] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47227221-8e24-429f-b3e4-917bd42f6a48 in Status: IN_PROGRESS for 2s [ 826.291361] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f4014f1-5014-4780-a1cb-d12ca67007a2 [ 826.291610] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.291744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.291815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.292038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.292134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.292229] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f4014f1-5014-4780-a1cb-d12ca67007a2 already deleted. [ 826.292312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f4014f1-5014-4780-a1cb-d12ca67007a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.339437] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.339756] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.339917] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.340340] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.340525] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.340728] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 33bd19f4-68c9-4496-8dc7-e3cb33124b77 not found, creating... [ 826.341048] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.341250] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.341402] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.341679] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.341861] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.342275] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.342493] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.342641] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.342881] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.343091] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.343251] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 33bd19f4-68c9-4496-8dc7-e3cb33124b77 is going to be created. [ 826.361440] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.361640] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.361773] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.362020] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.362238] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.362451] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-33bd19f4-68c9-4496-8dc7-e3cb33124b77" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.503058] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.503058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.503058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.503058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.503557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.503557] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 826.517352] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.517485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.517485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.518012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.518012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.518012] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.518193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.518193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.518382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.518414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.518499] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 is going to be updated. [ 826.534345] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.534512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.534575] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.534729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.534873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.556025] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 826.559230] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.559380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.559453] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.559665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.559808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.578983] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: IN_PROGRESS for 2s [ 826.845045] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: SUCCESS [ 826.845282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.913047] env[69777]: INFO networking_nsxv3.common.synchronization [None req-e5fe809f-b0e9-4d6f-9460-375b02b597ca tempest-ServerActionsV293TestJSON-1792954736 tempest-ServerActionsV293TestJSON-1792954736-project-member] Enqueued Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_rules [ 826.913047] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_rules [ 826.913047] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4058bf2e-e500-4002-898a-0d2b9aa510e5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.913047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.913047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.913047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.914915] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.045802] env[69777]: INFO networking_nsxv3.common.synchronization [None req-76824d2e-a067-46da-aed3-7bff227c960b tempest-ServerActionsV293TestJSON-1792954736 tempest-ServerActionsV293TestJSON-1792954736-project-member] Enqueued Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_rules [ 827.046414] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_rules [ 827.046710] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4058bf2e-e500-4002-898a-0d2b9aa510e5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.046813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.228567] env[69777]: INFO networking_nsxv3.common.synchronization [req-46e42c5a-7af0-4345-b2e9-f07618cbc9b4 req-cb614a56-8e2b-422b-9d89-e10f9aa11dc6 service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 827.228733] env[69777]: INFO networking_nsxv3.common.synchronization [req-46e42c5a-7af0-4345-b2e9-f07618cbc9b4 req-cb614a56-8e2b-422b-9d89-e10f9aa11dc6 service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 827.228904] env[69777]: INFO networking_nsxv3.common.synchronization [req-46e42c5a-7af0-4345-b2e9-f07618cbc9b4 req-cb614a56-8e2b-422b-9d89-e10f9aa11dc6 service nova] Enqueued Resource ID: 33bd19f4-68c9-4496-8dc7-e3cb33124b77 with Priority: HIGHEST for action port [ 827.229172] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 827.229301] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 827.229398] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33bd19f4-68c9-4496-8dc7-e3cb33124b77 with Priority: HIGHEST for action port [ 827.230378] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.230378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.230378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.230378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.230378] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.231435] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.231533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.231715] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-33bd19f4-68c9-4496-8dc7-e3cb33124b77 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.231831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33bd19f4-68c9-4496-8dc7-e3cb33124b77" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.231958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33bd19f4-68c9-4496-8dc7-e3cb33124b77" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.232105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33bd19f4-68c9-4496-8dc7-e3cb33124b77" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.232172] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33bd19f4-68c9-4496-8dc7-e3cb33124b77',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.440367] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.443268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.443268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.443268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.443268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.443268] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 already deleted. [ 827.443268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.443268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.443268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.443268] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.647367] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a1a0da81-70d0-4bf7-a31d-bb01ef305570 None None] Enqueued Resource ID: e290d6d5-c503-46fe-b087-feaa7343abe5 with Priority: HIGHEST for action port [ 827.648033] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e290d6d5-c503-46fe-b087-feaa7343abe5 with Priority: HIGHEST for action port [ 827.648405] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-e290d6d5-c503-46fe-b087-feaa7343abe5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.648562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e290d6d5-c503-46fe-b087-feaa7343abe5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.648645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e290d6d5-c503-46fe-b087-feaa7343abe5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.648966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e290d6d5-c503-46fe-b087-feaa7343abe5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.649481] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e290d6d5-c503-46fe-b087-feaa7343abe5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.734301] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.734301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.734301] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33bd19f4-68c9-4496-8dc7-e3cb33124b77 with status ACTIVE [ 827.734301] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.734562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.734562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.734688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.734761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.734929] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.735042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.735104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.735249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.735324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.735531] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.735687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.735802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.735952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.736114] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33bd19f4-68c9-4496-8dc7-e3cb33124b77 is going to be updated. [ 827.757969] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.758203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.758285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.758496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.758628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.758786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33bd19f4-68c9-4496-8dc7-e3cb33124b77" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.966535] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.966535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.966535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.966951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.966951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.966951] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 already deleted. [ 827.966951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.151636] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e290d6d5-c503-46fe-b087-feaa7343abe5 [ 828.151877] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.152017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.152088] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.153564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.153564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.153564] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e290d6d5-c503-46fe-b087-feaa7343abe5 already deleted. [ 828.153564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e290d6d5-c503-46fe-b087-feaa7343abe5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.229033] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47227221-8e24-429f-b3e4-917bd42f6a48 in Status: SUCCESS [ 828.229033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.565882] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 828.566718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.567026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.567800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.567800] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.567800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.567800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.567800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.568112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.568112] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.587011] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 in Status: SUCCESS [ 828.587193] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 deletion is rescheduled due to dependency. [ 828.587305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.073428] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.575335] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.083369] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.083731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.083731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.083731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.083847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.083875] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 830.113370] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.113531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.113591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.113933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.113985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.122137] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 830.779672] env[69777]: INFO networking_nsxv3.common.synchronization [req-2f6e4314-80b1-4985-913e-15be0af1c42d req-7b685ec0-2bda-4a22-863a-58c480a67072 tempest-ImagesOneServerNegativeTestJSON-1912736822 tempest-ImagesOneServerNegativeTestJSON-1912736822-project-member] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 830.780255] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 830.780566] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.780680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.780747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.780992] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.783258] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.783366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.783435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.783623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.783708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.783801] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.286526] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.286526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.286526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.287057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.287057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.287057] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.287057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.287057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.287653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.287653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.287653] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 already deleted. [ 831.287653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.547027] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-894 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.547027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.547027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.547027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.547027] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.547027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.547027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.547027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.547027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.547027] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.547027] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.547027] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.547654] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.547912] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.548119] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.548299] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.566483] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.566668] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 831.566804] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.566988] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.571032] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-8176603f-93e3-45d1-8899-59d250b183e7 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.571032] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-8176603f-93e3-45d1-8899-59d250b183e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.571032] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-8176603f-93e3-45d1-8899-59d250b183e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.571032] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-8176603f-93e3-45d1-8899-59d250b183e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.571032] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8176603f-93e3-45d1-8899-59d250b183e7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.612921] env[69777]: INFO networking_nsxv3.common.synchronization [None req-c7e7ca83-6e57-4534-b56d-acad95cfbf30 None None] Enqueued Resource ID: c2abb2c4-f8b4-4ad8-9828-de33c6cc2ab5 with Priority: HIGHEST for action port [ 831.613204] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2abb2c4-f8b4-4ad8-9828-de33c6cc2ab5 with Priority: HIGHEST for action port [ 831.613802] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2abb2c4-f8b4-4ad8-9828-de33c6cc2ab5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.613933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2abb2c4-f8b4-4ad8-9828-de33c6cc2ab5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.614021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2abb2c4-f8b4-4ad8-9828-de33c6cc2ab5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.614272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2abb2c4-f8b4-4ad8-9828-de33c6cc2ab5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.614347] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2abb2c4-f8b4-4ad8-9828-de33c6cc2ab5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.073559] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.073756] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.073888] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.074186] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.074343] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.074567] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 8176603f-93e3-45d1-8899-59d250b183e7 not found, creating... [ 832.074749] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.074916] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.075041] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.075268] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.075696] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.075791] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.076211] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.076211] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.076305] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.076396] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.076536] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 8176603f-93e3-45d1-8899-59d250b183e7 is going to be created. [ 832.095599] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.095904] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.096045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.096355] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.096606] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.096830] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-8176603f-93e3-45d1-8899-59d250b183e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.116926] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2abb2c4-f8b4-4ad8-9828-de33c6cc2ab5 [ 832.117170] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.117316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.117380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.117576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.117744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.117744] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2abb2c4-f8b4-4ad8-9828-de33c6cc2ab5 already deleted. [ 832.120106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2abb2c4-f8b4-4ad8-9828-de33c6cc2ab5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.133088] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 832.135149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.135149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.135149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.135149] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.135149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.135149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.135149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.135149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.135149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.135149] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.636877] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.637247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.637247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.638496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.638496] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.638496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.638496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.638496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.638496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.638496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.638496] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.638496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.638496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.638496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.638496] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.638868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.638868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.638868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.638868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.638960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.639181] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.143697] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06bee688-2b64-4a9b-b0eb-ee4c735a9c41: rpc.has_security_group_logging(os_id): False [ 833.176655] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.176655] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.176655] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.176655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.177385] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.177385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.177385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.177385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.177385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.177385] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 833.212333] env[69777]: INFO networking_nsxv3.common.synchronization [req-2f6e4314-80b1-4985-913e-15be0af1c42d req-995208d0-fac7-4bfe-b329-3342a8e03a30 service nova] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_rules [ 833.212333] env[69777]: INFO networking_nsxv3.common.synchronization [req-2f6e4314-80b1-4985-913e-15be0af1c42d req-995208d0-fac7-4bfe-b329-3342a8e03a30 service nova] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 833.212333] env[69777]: INFO networking_nsxv3.common.synchronization [req-2f6e4314-80b1-4985-913e-15be0af1c42d req-995208d0-fac7-4bfe-b329-3342a8e03a30 service nova] Enqueued Resource ID: 8176603f-93e3-45d1-8899-59d250b183e7 with Priority: HIGHEST for action port [ 833.212333] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_rules [ 833.212333] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 833.212333] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8176603f-93e3-45d1-8899-59d250b183e7 with Priority: HIGHEST for action port [ 833.212333] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.212333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.212333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.212652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.212652] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.213637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.213776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.213843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.214054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.214222] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.214328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.214407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.214586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.214679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.214773] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.216547] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-8176603f-93e3-45d1-8899-59d250b183e7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.216547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8176603f-93e3-45d1-8899-59d250b183e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.216547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8176603f-93e3-45d1-8899-59d250b183e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.216547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8176603f-93e3-45d1-8899-59d250b183e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.216547] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8176603f-93e3-45d1-8899-59d250b183e7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.249546] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.250219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.250305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.250510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.250706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.263024] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 833.718260] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.719117] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.719242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.719565] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8176603f-93e3-45d1-8899-59d250b183e7 with status ACTIVE [ 833.719760] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.719882] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.719951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.720310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.720423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.720568] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.720654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.720654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.720892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.720960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.721465] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.721578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.721651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.721861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.721941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.722066] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8176603f-93e3-45d1-8899-59d250b183e7 is going to be updated. [ 833.742468] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.742621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.742734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.742950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.743107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.743277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8176603f-93e3-45d1-8899-59d250b183e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.926518] env[69777]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] NSXv3 Agent Agent loop - iteration:0 completed [ 833.926747] env[69777]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] NSXv3 Agent Agent loop - iteration:1 started [ 834.094734] env[69777]: INFO networking_nsxv3.common.synchronization [req-6b31ae65-ba01-4d80-a302-f0d544ad9d85 req-c6afbc23-8ee2-464c-848c-481adcbc9d63 tempest-ServersAdminNegativeTestJSON-1845497165 tempest-ServersAdminNegativeTestJSON-1845497165-project-member] Enqueued Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 834.095294] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 834.095601] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.095743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.095837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.096066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.096245] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.096364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.096430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.096587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.096671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.096766] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.220550] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.373171] env[69777]: INFO networking_nsxv3.common.synchronization [None req-edc06371-0723-4d76-92c8-f58dff9acbdd None None] Enqueued Resource ID: e5684550-2be7-4623-bf4b-a0b4ef5dc4c8 with Priority: HIGHEST for action port [ 834.373442] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5684550-2be7-4623-bf4b-a0b4ef5dc4c8 with Priority: HIGHEST for action port [ 834.374054] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5684550-2be7-4623-bf4b-a0b4ef5dc4c8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.374201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5684550-2be7-4623-bf4b-a0b4ef5dc4c8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.374281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5684550-2be7-4623-bf4b-a0b4ef5dc4c8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.374535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5684550-2be7-4623-bf4b-a0b4ef5dc4c8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.374642] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5684550-2be7-4623-bf4b-a0b4ef5dc4c8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.598997] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.703984] env[69777]: INFO networking_nsxv3.common.synchronization [req-6408a7e9-c4ea-4372-80b0-40467769455c req-0177d166-80bd-4d63-8793-20754c108627 tempest-ServerGroupTestJSON-723252485 tempest-ServerGroupTestJSON-723252485-project-member] Enqueued Resource ID: 93fa1adf-2111-4396-9725-628f0d0149a7 with Priority: HIGHEST for action security_group_members [ 834.703984] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93fa1adf-2111-4396-9725-628f0d0149a7 with Priority: HIGHEST for action security_group_members [ 834.705487] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-93fa1adf-2111-4396-9725-628f0d0149a7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.705487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.705487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.705487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.705487] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.705487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.705487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.710217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.710217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.710217] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93fa1adf-2111-4396-9725-628f0d0149a7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.727228] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.727228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.727228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.727228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.727228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.727228] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be created. [ 834.754188] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.754531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.754636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.754961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.757300] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.767527] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: UNINITIALIZED for 2s [ 834.881697] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5684550-2be7-4623-bf4b-a0b4ef5dc4c8 [ 834.881971] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.882275] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.882353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.882556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.882645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.882877] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5684550-2be7-4623-bf4b-a0b4ef5dc4c8 already deleted. [ 834.882991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5684550-2be7-4623-bf4b-a0b4ef5dc4c8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.103412] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.200833] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.201045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-439" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.201172] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-439" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.201506] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-439" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.201781] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.202713] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.203324] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.203601] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.203750] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.203960] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.204080] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.204188] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.204294] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.204400] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.204524] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.204629] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.211165] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.211287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.211353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.211529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.211612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.211796] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.211945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.212040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.212163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.213029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.213029] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93fa1adf-2111-4396-9725-628f0d0149a7 already deleted. [ 835.213029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.225021] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.225021] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.225021] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.225021] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-439" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.225021] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-56c80e1c-df3c-473d-a3a0-bc0444af9fb0 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.225021] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-56c80e1c-df3c-473d-a3a0-bc0444af9fb0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.225021] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-56c80e1c-df3c-473d-a3a0-bc0444af9fb0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.225021] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-56c80e1c-df3c-473d-a3a0-bc0444af9fb0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.225021] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56c80e1c-df3c-473d-a3a0-bc0444af9fb0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.275840] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 835.275840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.603844] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.604035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.604223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.604343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.604459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.604627] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 is going to be updated. [ 835.632036] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.632036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.632036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.632286] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.632435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.641092] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: IN_PROGRESS for 2s [ 835.727315] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.727666] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.727862] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.728276] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.728512] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.728741] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 56c80e1c-df3c-473d-a3a0-bc0444af9fb0 not found, creating... [ 835.729151] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.729385] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.729584] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.729913] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.730125] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.730571] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.730796] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.731012] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.731324] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.731520] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.731720] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 56c80e1c-df3c-473d-a3a0-bc0444af9fb0 is going to be created. [ 835.761639] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.762013] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.762234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.762613] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.762975] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.763326] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-56c80e1c-df3c-473d-a3a0-bc0444af9fb0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.464609] env[69777]: INFO networking_nsxv3.common.synchronization [req-6408a7e9-c4ea-4372-80b0-40467769455c req-f1b011d2-fec7-4644-9274-91b028689718 service nova] Enqueued Resource ID: 93fa1adf-2111-4396-9725-628f0d0149a7 with Priority: HIGHEST for action security_group_rules [ 836.464807] env[69777]: INFO networking_nsxv3.common.synchronization [req-6408a7e9-c4ea-4372-80b0-40467769455c req-f1b011d2-fec7-4644-9274-91b028689718 service nova] Enqueued Resource ID: 93fa1adf-2111-4396-9725-628f0d0149a7 with Priority: HIGHEST for action security_group_members [ 836.464951] env[69777]: INFO networking_nsxv3.common.synchronization [req-6408a7e9-c4ea-4372-80b0-40467769455c req-f1b011d2-fec7-4644-9274-91b028689718 service nova] Enqueued Resource ID: 56c80e1c-df3c-473d-a3a0-bc0444af9fb0 with Priority: HIGHEST for action port [ 836.465208] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93fa1adf-2111-4396-9725-628f0d0149a7 with Priority: HIGHEST for action security_group_rules [ 836.465341] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93fa1adf-2111-4396-9725-628f0d0149a7 with Priority: HIGHEST for action security_group_members [ 836.465439] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c80e1c-df3c-473d-a3a0-bc0444af9fb0 with Priority: HIGHEST for action port [ 836.466476] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93fa1adf-2111-4396-9725-628f0d0149a7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.466659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.466744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.467120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.467222] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93fa1adf-2111-4396-9725-628f0d0149a7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.469518] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-93fa1adf-2111-4396-9725-628f0d0149a7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.469518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.469518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.469518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.469518] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.469518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.469518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.469518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.469518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.469518] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93fa1adf-2111-4396-9725-628f0d0149a7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.470887] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-56c80e1c-df3c-473d-a3a0-bc0444af9fb0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.470887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56c80e1c-df3c-473d-a3a0-bc0444af9fb0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.470887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56c80e1c-df3c-473d-a3a0-bc0444af9fb0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.470887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56c80e1c-df3c-473d-a3a0-bc0444af9fb0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.470887] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56c80e1c-df3c-473d-a3a0-bc0444af9fb0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.775856] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: SUCCESS [ 836.776103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.776234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.776477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.776675] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.776796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.776901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.777041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.777126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.777224] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.777319] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.976037] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93fa1adf-2111-4396-9725-628f0d0149a7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.978376] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-93fa1adf-2111-4396-9725-628f0d0149a7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.979328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.979471] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56c80e1c-df3c-473d-a3a0-bc0444af9fb0 with status ACTIVE [ 836.979549] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.979685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.979754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.979957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.980087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.980291] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.980413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.980477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.980645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.980727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.981028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.981359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.981359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.981450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.981450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.981873] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56c80e1c-df3c-473d-a3a0-bc0444af9fb0 is going to be updated. [ 837.000912] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.001080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.001122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.001344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.001552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.001746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56c80e1c-df3c-473d-a3a0-bc0444af9fb0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.282996] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.283171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.283256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.283496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.283672] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.283785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.283853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.284020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.284122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.284215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.284373] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.284466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.284538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.284683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.284870] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.284936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.284999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.285164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.285242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.285332] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.285421] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.480405] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93fa1adf-2111-4396-9725-628f0d0149a7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.651689] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: SUCCESS [ 837.651823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.788669] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ceaf97c-1feb-4a95-a759-71b6308c5c38: rpc.has_security_group_logging(os_id): False [ 837.808290] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.808483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.808539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.810471] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.810471] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.810471] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.810471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.811273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.811273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.811273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.811273] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be created. [ 837.902912] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.903073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.903144] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.903360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.903534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.916084] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: IN_PROGRESS for 2s [ 837.984757] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.984757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.984757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.984986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.985111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.985212] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93fa1adf-2111-4396-9725-628f0d0149a7 is going to be created. [ 838.012758] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.012758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.012758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.012758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.012758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.028770] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93fa1adf-2111-4396-9725-628f0d0149a7 in Status: UNINITIALIZED for 2s [ 838.082638] env[69777]: INFO networking_nsxv3.common.synchronization [req-5aebcdcf-6f20-474b-bd2a-b4e58330ae58 req-ee0ea102-3bf1-4f20-bc2d-691a55221f84 tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 838.082638] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 838.082839] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.084755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.084755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.084755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.084755] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.084755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.084755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.084755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.084755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.084755] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.590173] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.590384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.590487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.591864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.591864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.591864] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.591864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.591864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.591864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.591864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.591864] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 838.617249] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.617460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.617529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.617728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.622007] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.630828] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 839.464629] env[69777]: INFO networking_nsxv3.common.synchronization [req-4da02e19-69c6-4345-aa57-41eba2700677 req-2acce73a-1c53-4a5e-8a71-09fbc5149925 tempest-ImagesTestJSON-42450789 tempest-ImagesTestJSON-42450789-project-member] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 839.465118] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 839.465459] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.465614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.465690] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.465898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.466051] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.466150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.466212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.466358] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.466447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.466526] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.926946] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: SUCCESS [ 839.927258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.968938] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.969111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.969183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.969408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.969503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.969737] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.969838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.969873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.969996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.970087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.970174] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 839.994301] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.994403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.994475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.994694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.994832] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.003577] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 840.041932] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93fa1adf-2111-4396-9725-628f0d0149a7 in Status: SUCCESS [ 840.041932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.041932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.042104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.042240] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.042351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.042422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.042571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.042641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.042728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.042815] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93fa1adf-2111-4396-9725-628f0d0149a7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.084622] env[69777]: INFO networking_nsxv3.common.synchronization [req-ee9b3cb4-9336-4d06-90c0-88d1b2191543 req-07b1fac5-02c7-4741-bb39-6d8b1583e15d tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 840.085250] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 840.085817] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.086027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.086096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.086417] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.086646] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.086786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.086903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.087136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.087286] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.087435] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.546081] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-93fa1adf-2111-4396-9725-628f0d0149a7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.546544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.546544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.546544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.546673] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.546759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.546863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.546998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.547070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.547142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.547288] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-93fa1adf-2111-4396-9725-628f0d0149a7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.547384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.547490] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.547650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.547773] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.547887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.547957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.548057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.548130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.548198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.548351] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93fa1adf-2111-4396-9725-628f0d0149a7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.590327] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.639338] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 840.639520] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 deletion is rescheduled due to dependency. [ 840.639618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.053134] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93fa1adf-2111-4396-9725-628f0d0149a7: rpc.has_security_group_logging(os_id): False [ 841.070844] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.070844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.070844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.071049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.071049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.071219] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.071313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.071536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.071536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.071649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.071765] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.071842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.071903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.072139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.072139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.072347] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.072453] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.072507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.072651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.072916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.072916] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93fa1adf-2111-4396-9725-628f0d0149a7 is going to be created. [ 841.092854] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.124126] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.124273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.124348] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.124630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.124837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.138702] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93fa1adf-2111-4396-9725-628f0d0149a7 in Status: IN_PROGRESS for 2s [ 841.233659] env[69777]: INFO networking_nsxv3.common.synchronization [req-01299132-70ad-42eb-b027-2c2c00d80579 req-892759a8-5623-472d-96f9-4c808e14fa4e tempest-MigrationsAdminTest-640993244 tempest-MigrationsAdminTest-640993244-project-member] Enqueued Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 841.234264] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 841.234607] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.234748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.234836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.235076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.235243] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.235353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.236534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.236534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.236534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.236534] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.596148] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.596524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.596524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.596775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.596775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.596868] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 841.623907] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.624090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.624158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.624368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.624764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.634048] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 841.717737] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.718081] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.718163] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.720204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.720204] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.720204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.720204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.720204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.720204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.720204] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.720204] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.720204] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.720204] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.720204] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.720204] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.720204] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.737882] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.741744] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.741997] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.742179] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.742363] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.742972] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-3308bbe5-118d-4a25-bb3e-e01744edf7ee taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.743373] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-3308bbe5-118d-4a25-bb3e-e01744edf7ee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.743373] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-3308bbe5-118d-4a25-bb3e-e01744edf7ee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.743732] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-3308bbe5-118d-4a25-bb3e-e01744edf7ee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.743878] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3308bbe5-118d-4a25-bb3e-e01744edf7ee',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.016153] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 842.016153] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 deletion is rescheduled due to dependency. [ 842.016153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.239902] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.246229] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.246791] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.246956] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.247271] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.247461] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.247634] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 3308bbe5-118d-4a25-bb3e-e01744edf7ee not found, creating... [ 842.248022] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.248583] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.248583] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.248690] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.249032] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.249434] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.249612] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.249748] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.249981] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.250319] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.250389] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 3308bbe5-118d-4a25-bb3e-e01744edf7ee is going to be created. [ 842.270582] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.270799] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.270936] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.271500] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.271757] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.272012] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-3308bbe5-118d-4a25-bb3e-e01744edf7ee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.742997] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.743643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.743643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.743643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.743643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.743792] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e is going to be updated. [ 842.783055] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.783055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.783055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.783055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.783055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.798117] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: IN_PROGRESS for 2s [ 843.035681] env[69777]: INFO networking_nsxv3.common.synchronization [None req-f78c2f3c-cbc3-46ad-b5ae-8b2a2d3ca4d6 None None] Enqueued Resource ID: 16a302f3-4159-4940-8450-2f816f3dca01 with Priority: HIGHEST for action port [ 843.035681] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16a302f3-4159-4940-8450-2f816f3dca01 with Priority: HIGHEST for action port [ 843.035681] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-16a302f3-4159-4940-8450-2f816f3dca01 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.035681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16a302f3-4159-4940-8450-2f816f3dca01" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.035681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16a302f3-4159-4940-8450-2f816f3dca01" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.035681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16a302f3-4159-4940-8450-2f816f3dca01" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.035681] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16a302f3-4159-4940-8450-2f816f3dca01',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.154892] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93fa1adf-2111-4396-9725-628f0d0149a7 in Status: SUCCESS [ 843.155142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.542725] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16a302f3-4159-4940-8450-2f816f3dca01 [ 843.542725] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.542725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.542725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.542725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.542725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.542725] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16a302f3-4159-4940-8450-2f816f3dca01 already deleted. [ 843.542725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16a302f3-4159-4940-8450-2f816f3dca01" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.622281] env[69777]: INFO networking_nsxv3.common.synchronization [req-01299132-70ad-42eb-b027-2c2c00d80579 req-8607f768-47f7-4d83-9b9e-3fd8eab4b56c service nova] Enqueued Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_rules [ 843.622514] env[69777]: INFO networking_nsxv3.common.synchronization [req-01299132-70ad-42eb-b027-2c2c00d80579 req-8607f768-47f7-4d83-9b9e-3fd8eab4b56c service nova] Enqueued Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 843.622690] env[69777]: INFO networking_nsxv3.common.synchronization [req-01299132-70ad-42eb-b027-2c2c00d80579 req-8607f768-47f7-4d83-9b9e-3fd8eab4b56c service nova] Enqueued Resource ID: 3308bbe5-118d-4a25-bb3e-e01744edf7ee with Priority: HIGHEST for action port [ 843.623532] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_rules [ 843.623532] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 843.623532] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3308bbe5-118d-4a25-bb3e-e01744edf7ee with Priority: HIGHEST for action port [ 843.623839] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.623990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.624093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.624324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.624407] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.625343] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.625485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.625719] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-3308bbe5-118d-4a25-bb3e-e01744edf7ee taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.625883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3308bbe5-118d-4a25-bb3e-e01744edf7ee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.626085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3308bbe5-118d-4a25-bb3e-e01744edf7ee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.626184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3308bbe5-118d-4a25-bb3e-e01744edf7ee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.626273] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3308bbe5-118d-4a25-bb3e-e01744edf7ee',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.643665] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 843.643901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.131185] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.131185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.131185] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3308bbe5-118d-4a25-bb3e-e01744edf7ee with status ACTIVE [ 844.131185] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.131185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.131185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.131185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.131185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.131185] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.131185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.131185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.131185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.131185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.131185] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.131819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.131819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.131819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.131819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.131819] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3308bbe5-118d-4a25-bb3e-e01744edf7ee is going to be updated. [ 844.151967] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.151967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.151967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.151967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.151967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.151967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3308bbe5-118d-4a25-bb3e-e01744edf7ee" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.808077] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: SUCCESS [ 844.808324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.808489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.808697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.808894] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.809012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.809084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.809229] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.809303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.809396] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.153017] env[69777]: INFO networking_nsxv3.common.synchronization [None req-02f5005b-8e2d-432f-a0bd-6353d3886a7a None None] Enqueued Resource ID: 19cf969b-478c-4c3c-8877-2ee6a4129289 with Priority: HIGHEST for action port [ 845.154040] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19cf969b-478c-4c3c-8877-2ee6a4129289 with Priority: HIGHEST for action port [ 845.154837] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-19cf969b-478c-4c3c-8877-2ee6a4129289 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.155133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19cf969b-478c-4c3c-8877-2ee6a4129289" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.155290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19cf969b-478c-4c3c-8877-2ee6a4129289" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.155633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19cf969b-478c-4c3c-8877-2ee6a4129289" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.155810] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19cf969b-478c-4c3c-8877-2ee6a4129289',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.313693] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.659161] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19cf969b-478c-4c3c-8877-2ee6a4129289 [ 845.660306] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.660306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.660306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.660306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.660306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.660306] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19cf969b-478c-4c3c-8877-2ee6a4129289 already deleted. [ 845.660306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19cf969b-478c-4c3c-8877-2ee6a4129289" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.821152] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.325895] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.329356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.329356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.329356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.329356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.329356] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e is going to be updated. [ 846.354900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.355056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.355132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.355393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.355560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.364341] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: IN_PROGRESS for 2s [ 846.751684] env[69777]: INFO networking_nsxv3.common.synchronization [req-c0610a97-adb4-4cab-96c3-ce459ad58283 req-ff3d9af5-7979-4c3a-8450-4a2a6ba5c194 tempest-ServerGroupTestJSON-723252485 tempest-ServerGroupTestJSON-723252485-project-member] Enqueued Resource ID: 93fa1adf-2111-4396-9725-628f0d0149a7 with Priority: HIGHEST for action security_group_members [ 846.752326] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93fa1adf-2111-4396-9725-628f0d0149a7 with Priority: HIGHEST for action security_group_members [ 846.752657] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-93fa1adf-2111-4396-9725-628f0d0149a7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.752787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.752858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.755585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.755789] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.755938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.755993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.756200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.756289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.756394] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93fa1adf-2111-4396-9725-628f0d0149a7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.263730] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.265223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.265223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.265223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.265223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.265223] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.265223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.265223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.265223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.265223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.265223] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93fa1adf-2111-4396-9725-628f0d0149a7 is going to be updated. [ 847.291357] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.291357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.291357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.291357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.291653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.300605] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93fa1adf-2111-4396-9725-628f0d0149a7 in Status: IN_PROGRESS for 2s [ 848.373491] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: SUCCESS [ 848.373819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.373897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.374134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.374328] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.374437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.374495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.374649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.374727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.374810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.374898] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.822465] env[69777]: INFO networking_nsxv3.common.synchronization [req-ca25dacb-ec77-48d1-88c0-cc46ca859222 req-ed2f55ba-c8f2-4632-b63d-829f9c51d722 tempest-ServersAdminTestJSON-1100102510 tempest-ServersAdminTestJSON-1100102510-project-member] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 848.822465] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 848.822465] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.822465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.822465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.824938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.824938] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.824938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.824938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.824938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.824938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.826921] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.879488] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.879488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.879488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.879488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.879488] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.879488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.879488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.879488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.879488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.880393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.880393] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.880393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.880393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.880393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.880393] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.880393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.880393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.880766] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.880766] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.880766] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.880887] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.310594] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93fa1adf-2111-4396-9725-628f0d0149a7 in Status: SUCCESS [ 849.310802] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93fa1adf-2111-4396-9725-628f0d0149a7 deletion is rescheduled due to dependency. [ 849.310994] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.328377] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.389433] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc849ff0-58d8-4b9a-9f49-53853fea6a2e: rpc.has_security_group_logging(os_id): False [ 849.404852] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.405010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.405084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.405297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.405454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.405600] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.405694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.405754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.405901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.405971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.406158] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.406245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.406309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.406445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.406514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.406683] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.406771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.406830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.406963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.407111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.407206] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e is going to be updated. [ 849.412640] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.412746] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.413045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.413045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.413326] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.413469] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.413571] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.413812] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.413973] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.414220] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.414367] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.414485] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.414598] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.414713] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.414819] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.415029] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.433903] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.434102] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.434254] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.434437] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-561" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.434802] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-1a13cd85-f479-4d80-8e2e-290f7f47ad56 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.435028] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-1a13cd85-f479-4d80-8e2e-290f7f47ad56" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.435160] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-1a13cd85-f479-4d80-8e2e-290f7f47ad56" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.435482] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-1a13cd85-f479-4d80-8e2e-290f7f47ad56" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.435634] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a13cd85-f479-4d80-8e2e-290f7f47ad56',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.471860] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.471860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.471860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.471860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.471860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.482089] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: IN_PROGRESS for 2s [ 849.836151] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.937907] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.938407] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.938556] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.938849] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.939180] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.939378] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 1a13cd85-f479-4d80-8e2e-290f7f47ad56 not found, creating... [ 849.939661] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.939830] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.939953] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.940620] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.940620] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.940820] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.940987] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.941101] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.941325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.941466] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.941609] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 1a13cd85-f479-4d80-8e2e-290f7f47ad56 is going to be created. [ 849.959786] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.959937] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.960021] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.960337] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.961800] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.961800] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-1a13cd85-f479-4d80-8e2e-290f7f47ad56" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.344576] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.344793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.344844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.345684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.345684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.345684] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 850.370969] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.371155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.371206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.371445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.371605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.380535] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 850.807736] env[69777]: INFO networking_nsxv3.common.synchronization [req-ca25dacb-ec77-48d1-88c0-cc46ca859222 req-f95b5405-2768-47e7-bd85-6e0ac66d8fa5 service nova] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_rules [ 850.808057] env[69777]: INFO networking_nsxv3.common.synchronization [req-ca25dacb-ec77-48d1-88c0-cc46ca859222 req-f95b5405-2768-47e7-bd85-6e0ac66d8fa5 service nova] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 850.808127] env[69777]: INFO networking_nsxv3.common.synchronization [req-ca25dacb-ec77-48d1-88c0-cc46ca859222 req-f95b5405-2768-47e7-bd85-6e0ac66d8fa5 service nova] Enqueued Resource ID: 1a13cd85-f479-4d80-8e2e-290f7f47ad56 with Priority: HIGHEST for action port [ 850.808374] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_rules [ 850.808503] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 850.808600] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a13cd85-f479-4d80-8e2e-290f7f47ad56 with Priority: HIGHEST for action port [ 850.809538] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.809666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.809733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.809930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.810030] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.810842] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.810934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.812621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a13cd85-f479-4d80-8e2e-290f7f47ad56 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.812621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a13cd85-f479-4d80-8e2e-290f7f47ad56" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.812621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a13cd85-f479-4d80-8e2e-290f7f47ad56" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.812856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a13cd85-f479-4d80-8e2e-290f7f47ad56" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.812899] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a13cd85-f479-4d80-8e2e-290f7f47ad56',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.315372] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.315510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.315697] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a13cd85-f479-4d80-8e2e-290f7f47ad56 with status ACTIVE [ 851.315885] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.316016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.316088] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.316357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.316392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.316541] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.316635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.316697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.316844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.316918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.317145] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.317223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.317262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.317385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.317459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.317540] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a13cd85-f479-4d80-8e2e-290f7f47ad56 is going to be updated. [ 851.348976] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.349312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.349312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.349401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.349543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.349711] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a13cd85-f479-4d80-8e2e-290f7f47ad56" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.446917] env[69777]: INFO networking_nsxv3.common.synchronization [req-40d85d75-2c25-46c3-acff-a777d13ef36c req-f72db5b2-eeeb-4d15-9bc6-f3ad473e6fee tempest-ServersNegativeTestJSON-1844530137 tempest-ServersNegativeTestJSON-1844530137-project-member] Enqueued Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 851.447490] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 851.447790] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.447904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.447993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.448362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.448443] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.448523] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.448583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.448727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.448810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.448901] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.499750] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: SUCCESS [ 851.499989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.953533] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.953844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.953844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.954057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.954203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.954428] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.954576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.955463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.955463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.955463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.960483] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 already deleted. [ 851.960623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.241656] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.241921] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.242087] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.242645] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.242966] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.243195] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.244042] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.244404] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.245257] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.245257] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.245257] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.245257] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.245257] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.245404] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.245540] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.245762] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.266940] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.267135] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 852.267278] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.267446] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.267753] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-f2675e22-1a2f-4fdc-a364-397cd259d5d7 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.267922] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.268108] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.268471] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.268628] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2675e22-1a2f-4fdc-a364-397cd259d5d7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.391021] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 852.391129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.391268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.391479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.391662] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.391781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.391848] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.391993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.392089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.392184] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.774205] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.774433] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.774559] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.774838] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.774983] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.775182] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port f2675e22-1a2f-4fdc-a364-397cd259d5d7 not found, creating... [ 852.775402] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.775553] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.775668] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.776038] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.776272] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.776606] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.776770] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.776879] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.778978] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.778978] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.778978] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: f2675e22-1a2f-4fdc-a364-397cd259d5d7 is going to be created. [ 852.798172] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.798407] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.798532] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.798812] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.799094] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.799329] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.895667] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.399830] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.825077] env[69777]: INFO networking_nsxv3.common.synchronization [req-40d85d75-2c25-46c3-acff-a777d13ef36c req-00252957-aace-4f0a-a154-d7709932037a service nova] Enqueued Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_rules [ 853.825271] env[69777]: INFO networking_nsxv3.common.synchronization [req-40d85d75-2c25-46c3-acff-a777d13ef36c req-00252957-aace-4f0a-a154-d7709932037a service nova] Enqueued Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 853.825451] env[69777]: INFO networking_nsxv3.common.synchronization [req-40d85d75-2c25-46c3-acff-a777d13ef36c req-00252957-aace-4f0a-a154-d7709932037a service nova] Enqueued Resource ID: f2675e22-1a2f-4fdc-a364-397cd259d5d7 with Priority: HIGHEST for action port [ 853.825666] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_rules [ 853.825790] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 853.826086] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2675e22-1a2f-4fdc-a364-397cd259d5d7 with Priority: HIGHEST for action port [ 853.826514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.826628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.826628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.826868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.826954] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.832033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.832033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.832033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.832033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.832033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.832033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.832033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.832033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.832033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.832033] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.835946] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2675e22-1a2f-4fdc-a364-397cd259d5d7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.835946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.835946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.835946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.835946] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2675e22-1a2f-4fdc-a364-397cd259d5d7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.901731] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.901887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.901933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.902169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.902253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.902348] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 853.930596] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.930744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.930806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.931027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.931172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.940250] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 854.226609] env[69777]: INFO networking_nsxv3.common.synchronization [req-551640b6-b737-4910-92b2-82682a0f191b req-d6d7fd38-260f-407f-8629-b4d4ba0109ac tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 854.227158] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 854.227459] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.227577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.227646] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.227887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.228089] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.228195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.228258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.228412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.228494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.228586] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.333854] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.336064] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2675e22-1a2f-4fdc-a364-397cd259d5d7 with status ACTIVE [ 854.336306] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.336406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.336483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.336668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.336755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.336924] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.337036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.337121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.337281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.337359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.337540] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.337633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.337695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.337829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.337902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.338018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2675e22-1a2f-4fdc-a364-397cd259d5d7 is going to be updated. [ 854.339325] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.339452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.360459] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.360844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.360965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.361215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.361503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.361709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.587744] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.588131] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.588198] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.588447] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.588713] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.588870] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.589012] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.589259] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.589615] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.589615] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.589715] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.589822] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.589930] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.590052] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.590163] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.590301] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.610532] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.610739] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 854.610918] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.611164] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.611517] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-ad54f039-12a0-4ef3-92cc-aa63a4f05949 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.611744] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-ad54f039-12a0-4ef3-92cc-aa63a4f05949" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.611874] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-ad54f039-12a0-4ef3-92cc-aa63a4f05949" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.612213] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-ad54f039-12a0-4ef3-92cc-aa63a4f05949" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.612356] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad54f039-12a0-4ef3-92cc-aa63a4f05949',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.732857] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.732857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.732857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.732857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.732857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.733231] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.733231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.733381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.733649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.733780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.733939] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 already deleted. [ 854.735066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.840548] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.114790] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.115170] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.115368] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.115746] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.116104] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.116168] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port ad54f039-12a0-4ef3-92cc-aa63a4f05949 not found, creating... [ 855.116460] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.116638] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.117804] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.117804] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.117804] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.117804] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.118033] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.118154] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.118369] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.118602] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.118905] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: ad54f039-12a0-4ef3-92cc-aa63a4f05949 is going to be created. [ 855.156158] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.156498] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.156815] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.157750] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.159410] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.159410] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-ad54f039-12a0-4ef3-92cc-aa63a4f05949" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.343136] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.343136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.343136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.343356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.343455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.343565] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 is going to be created. [ 855.371050] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.371050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.371050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.371050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.371202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.391016] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: UNINITIALIZED for 2s [ 855.949795] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 855.949795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.949795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.950102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.950134] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.950244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.954342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.956972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.956972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.956972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.956972] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.102016] env[69777]: INFO networking_nsxv3.common.synchronization [req-551640b6-b737-4910-92b2-82682a0f191b req-dfc18745-9c16-451a-944a-988422437547 service nova] Enqueued Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_rules [ 856.102016] env[69777]: INFO networking_nsxv3.common.synchronization [req-551640b6-b737-4910-92b2-82682a0f191b req-dfc18745-9c16-451a-944a-988422437547 service nova] Enqueued Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 856.102016] env[69777]: INFO networking_nsxv3.common.synchronization [req-551640b6-b737-4910-92b2-82682a0f191b req-dfc18745-9c16-451a-944a-988422437547 service nova] Enqueued Resource ID: ad54f039-12a0-4ef3-92cc-aa63a4f05949 with Priority: HIGHEST for action port [ 856.102802] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_rules [ 856.103864] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 856.107019] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad54f039-12a0-4ef3-92cc-aa63a4f05949 with Priority: HIGHEST for action port [ 856.107019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.107019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.107019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.107019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.107019] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.107019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.107019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.107019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.107019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.107019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.107019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.107019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.107019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.107019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.107019] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.111225] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad54f039-12a0-4ef3-92cc-aa63a4f05949 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.111225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad54f039-12a0-4ef3-92cc-aa63a4f05949" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.111225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad54f039-12a0-4ef3-92cc-aa63a4f05949" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.111225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad54f039-12a0-4ef3-92cc-aa63a4f05949" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.111225] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad54f039-12a0-4ef3-92cc-aa63a4f05949',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.223703] env[69777]: INFO networking_nsxv3.common.synchronization [req-f148ec3c-fe2c-490f-9625-c6233c0c517c req-68dc27d7-f610-4667-aaa6-646992cf958e tempest-ImagesOneServerNegativeTestJSON-1912736822 tempest-ImagesOneServerNegativeTestJSON-1912736822-project-member] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 856.225025] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 856.225025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.227205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.227205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.227205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.227205] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.227205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.227205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.227205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.227205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.227205] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.457634] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.457894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.458060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.458341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.458519] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.458630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.458697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.458855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.458945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.459045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.459199] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.459289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.459351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.459490] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.459623] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.459712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.459772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.459904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.459978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.460073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.460161] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.611411] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.612125] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.612125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.615671] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad54f039-12a0-4ef3-92cc-aa63a4f05949 with status ACTIVE [ 856.615671] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.615671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.615671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.615671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.615671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.615671] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.616753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.616753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.616753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.616753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.616753] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.616753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.616753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.616753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.616753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.616753] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad54f039-12a0-4ef3-92cc-aa63a4f05949 is going to be updated. [ 856.643323] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.643323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.643497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.643908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.644057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.644383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad54f039-12a0-4ef3-92cc-aa63a4f05949" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.733510] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.733657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.733728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.734127] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.734127] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.734244] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.734320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.735042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.735042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.735042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.735042] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be updated. [ 856.771442] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.774021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.774021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.774021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.774021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.782940] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: IN_PROGRESS for 2s [ 856.926189] env[69777]: INFO networking_nsxv3.common.synchronization [req-96ba6ba7-7324-44cc-9099-6733e1a19384 req-6f641736-8f85-456a-82e9-098d6400d797 tempest-ServerActionsTestOtherB-1106354566 tempest-ServerActionsTestOtherB-1106354566-project-member] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 856.926189] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 856.931578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.931842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.931928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.932291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.932578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.932736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.932736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.932979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.933051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.933181] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.962294] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e: rpc.has_security_group_logging(os_id): False [ 856.983022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.983022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.983022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.983022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.983574] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.983574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.983574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.986561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.986561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.986561] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 857.045171] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.045171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.045171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.045171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.045171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.058337] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 857.114378] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.380924] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.381389] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.381588] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.381908] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.382256] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.382411] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.382583] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.382831] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.382969] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.383304] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.383424] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.383529] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.383632] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.383736] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.383889] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.384098] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.398957] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: SUCCESS [ 857.399392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.399557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.399763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.399968] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.400077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.400134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.400285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.400362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.400444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.400531] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.413279] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.413279] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 857.413279] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.413279] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.413279] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-cb28e0b4-662c-4acf-8909-8870fb3c5a8b taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.413279] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-cb28e0b4-662c-4acf-8909-8870fb3c5a8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.413279] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-cb28e0b4-662c-4acf-8909-8870fb3c5a8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.413279] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-cb28e0b4-662c-4acf-8909-8870fb3c5a8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.413279] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb28e0b4-662c-4acf-8909-8870fb3c5a8b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.435143] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.435309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.435386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.435600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.435691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.435879] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.435976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.436071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.436225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.436305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.436394] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 already deleted. [ 857.436474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.616049] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.616254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.616293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.616489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.616578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.616676] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 is going to be created. [ 857.643054] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.643054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.643261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.643290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.643438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.652098] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: UNINITIALIZED for 2s [ 857.903469] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.903770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.903898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.904196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.904365] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.904470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.904537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.904686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.904777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.904868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.905028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.905135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.905198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.905356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.905819] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.905998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.906425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.906694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.906833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.906961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.907130] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.915382] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.915627] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.915791] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.916124] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.916452] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.916645] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port cb28e0b4-662c-4acf-8909-8870fb3c5a8b not found, creating... [ 857.916940] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.917179] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.917344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.917595] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.917779] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.918132] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.918355] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.918512] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.918753] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.919079] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.919079] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: cb28e0b4-662c-4acf-8909-8870fb3c5a8b is going to be created. [ 857.952420] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.952638] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.952762] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.953056] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.953293] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.953518] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-cb28e0b4-662c-4acf-8909-8870fb3c5a8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.409425] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0519206-80b2-42a4-bf40-fb2cb2292017: rpc.has_security_group_logging(os_id): False [ 858.426527] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.426706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.426747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.426936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.427049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.427241] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.427385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.427470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.427692] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.427837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.428207] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.428351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.428470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.428696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.428814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.429140] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.429285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.429379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.429559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.429667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.429779] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 is going to be created. [ 858.481861] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.482056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.482142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.482493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.482611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.492830] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: IN_PROGRESS for 2s [ 858.755593] env[69777]: INFO networking_nsxv3.common.synchronization [req-96ba6ba7-7324-44cc-9099-6733e1a19384 req-9b53171b-938b-4c65-b3d8-413a9586fd2c service nova] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 858.755776] env[69777]: INFO networking_nsxv3.common.synchronization [req-96ba6ba7-7324-44cc-9099-6733e1a19384 req-9b53171b-938b-4c65-b3d8-413a9586fd2c service nova] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 858.755914] env[69777]: INFO networking_nsxv3.common.synchronization [req-96ba6ba7-7324-44cc-9099-6733e1a19384 req-9b53171b-938b-4c65-b3d8-413a9586fd2c service nova] Enqueued Resource ID: cb28e0b4-662c-4acf-8909-8870fb3c5a8b with Priority: HIGHEST for action port [ 858.756191] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 858.756345] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 858.756457] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb28e0b4-662c-4acf-8909-8870fb3c5a8b with Priority: HIGHEST for action port [ 858.757012] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.757391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.757463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.757663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.757773] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.758996] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.759122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.759193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.759386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.759577] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.759636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.759703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.759851] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.759935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.760067] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.761059] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb28e0b4-662c-4acf-8909-8870fb3c5a8b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.761059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb28e0b4-662c-4acf-8909-8870fb3c5a8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.761059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb28e0b4-662c-4acf-8909-8870fb3c5a8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.761362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb28e0b4-662c-4acf-8909-8870fb3c5a8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.761362] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb28e0b4-662c-4acf-8909-8870fb3c5a8b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.791701] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: SUCCESS [ 858.791962] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 deletion is rescheduled due to dependency. [ 858.792098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.069207] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 859.069525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.269702] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.269702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.269702] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.269702] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb28e0b4-662c-4acf-8909-8870fb3c5a8b with status ACTIVE [ 859.269702] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.269702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.269702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.269702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.269702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.269702] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.269702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.269702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.269702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.269702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.270155] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.270155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.270155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.270155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.270155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.270664] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb28e0b4-662c-4acf-8909-8870fb3c5a8b is going to be updated. [ 859.294014] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.294014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.294014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.294014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.294014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.294014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb28e0b4-662c-4acf-8909-8870fb3c5a8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.664378] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: SUCCESS [ 859.664378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.664378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.664734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.664734] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.664823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.665403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.665403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.665403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.665403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.665403] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.773705] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.170099] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.170267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.170341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.170565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.170728] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.170844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.170910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.171070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.171171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.171272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.171498] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.171498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.171583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.171683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.171815] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.171904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.171965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.172114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.172190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.172270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.172359] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.277493] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.277637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.277693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.278720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.281661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.281661] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be created. [ 860.304763] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.304945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.305032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.305995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.305995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.316943] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: UNINITIALIZED for 2s [ 860.511665] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: SUCCESS [ 860.512080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.676991] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfc00e54-a878-499a-acb4-f2b1c4844df7: rpc.has_security_group_logging(os_id): False [ 860.695262] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.695438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.695513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.695751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.695863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.696156] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.696251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.696331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.696498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.696583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.696806] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.696936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.697025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.697199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.697295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.697479] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.697594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.698055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.698214] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.698311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.698339] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 is going to be created. [ 860.753730] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.753886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.753958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.754230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.754425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.779198] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: IN_PROGRESS for 2s [ 862.329297] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 862.330448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.330448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.330448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.330448] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.330448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.330448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.330663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.330663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.330792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.330883] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.793464] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: SUCCESS [ 862.793585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.818295] env[69777]: INFO networking_nsxv3.common.synchronization [req-3d8c95f0-d59d-4c4c-82bc-71bb1e196911 req-f9ea4076-a722-4d04-855f-1b932d0c6e67 tempest-ServersTestMultiNic-1821210824 tempest-ServersTestMultiNic-1821210824-project-member] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 862.818665] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 862.818954] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.820164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.820248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.820509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.820689] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.820798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.820873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.821062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.821172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.821265] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.834092] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.323774] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.323774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.323774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.324147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.324147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.324814] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.324814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.324814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.325017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.325017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.325126] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 863.337193] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd51d8a4-0c41-4e95-a3e3-1f0da556ee84: rpc.has_security_group_logging(os_id): False [ 863.353248] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.353450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.353521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.353684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.353824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.356755] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.356892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.357065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.357140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.357228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.357464] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.357577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.357870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.360927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.360927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.360927] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be created. [ 863.363358] env[69777]: INFO networking_nsxv3.common.synchronization [req-3d8c95f0-d59d-4c4c-82bc-71bb1e196911 req-95e6a376-080f-40ba-8382-a69c67842e67 tempest-ServersTestMultiNic-1821210824 tempest-ServersTestMultiNic-1821210824-project-member] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 863.364328] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 863.365150] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.365150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.369811] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 863.418602] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.418673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.418751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.418978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.419135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.431033] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 863.832845] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.833061] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.833169] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.833503] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.833760] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.833914] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.834044] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.834734] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.834734] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.834734] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.834734] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.834911] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.834911] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.834992] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.835178] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.835237] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.854149] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.854149] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 863.854149] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.854149] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-838" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.854149] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-0f399be6-d049-462d-b734-b3b82f3e5515 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.854149] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-0f399be6-d049-462d-b734-b3b82f3e5515" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.854149] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-0f399be6-d049-462d-b734-b3b82f3e5515" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.854149] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-0f399be6-d049-462d-b734-b3b82f3e5515" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.854149] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f399be6-d049-462d-b734-b3b82f3e5515',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.076517] env[69777]: INFO networking_nsxv3.common.synchronization [None req-aef9ebcb-f1a1-450e-9b50-f443e1d1e486 None None] Enqueued Resource ID: a52fd1a7-91ce-4cec-ae78-395cd9ffa73c with Priority: HIGHEST for action port [ 864.077054] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52fd1a7-91ce-4cec-ae78-395cd9ffa73c with Priority: HIGHEST for action port [ 864.077407] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a52fd1a7-91ce-4cec-ae78-395cd9ffa73c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.077516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a52fd1a7-91ce-4cec-ae78-395cd9ffa73c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.077550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a52fd1a7-91ce-4cec-ae78-395cd9ffa73c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.077829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a52fd1a7-91ce-4cec-ae78-395cd9ffa73c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.077915] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a52fd1a7-91ce-4cec-ae78-395cd9ffa73c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.359024] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.359024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.359024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.359024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.359024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.359024] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 0f399be6-d049-462d-b734-b3b82f3e5515 not found, creating... [ 864.359024] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.359024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.359024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.359024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.359024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.359869] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.359869] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.359869] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.360447] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.360728] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.361115] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 0f399be6-d049-462d-b734-b3b82f3e5515 is going to be created. [ 864.384325] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.384325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.384325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.384325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.384325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.384325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-0f399be6-d049-462d-b734-b3b82f3e5515" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.581941] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a52fd1a7-91ce-4cec-ae78-395cd9ffa73c [ 864.582055] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.582179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.582252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.582469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.582554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.582651] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a52fd1a7-91ce-4cec-ae78-395cd9ffa73c already deleted. [ 864.582728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a52fd1a7-91ce-4cec-ae78-395cd9ffa73c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.363101] env[69777]: INFO networking_nsxv3.common.synchronization [req-3d8c95f0-d59d-4c4c-82bc-71bb1e196911 req-505a8455-2438-4ca2-8fb9-06f8de52149f service nova] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_rules [ 865.363348] env[69777]: INFO networking_nsxv3.common.synchronization [req-3d8c95f0-d59d-4c4c-82bc-71bb1e196911 req-505a8455-2438-4ca2-8fb9-06f8de52149f service nova] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 865.363390] env[69777]: INFO networking_nsxv3.common.synchronization [req-3d8c95f0-d59d-4c4c-82bc-71bb1e196911 req-505a8455-2438-4ca2-8fb9-06f8de52149f service nova] Enqueued Resource ID: 0f399be6-d049-462d-b734-b3b82f3e5515 with Priority: HIGHEST for action port [ 865.363926] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_rules [ 865.364100] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 865.364206] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f399be6-d049-462d-b734-b3b82f3e5515 with Priority: HIGHEST for action port [ 865.364503] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.364628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.364702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.364919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.365015] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.366537] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.366655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.367315] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f399be6-d049-462d-b734-b3b82f3e5515 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.367442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f399be6-d049-462d-b734-b3b82f3e5515" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.367528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f399be6-d049-462d-b734-b3b82f3e5515" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.367726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f399be6-d049-462d-b734-b3b82f3e5515" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.367824] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f399be6-d049-462d-b734-b3b82f3e5515',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.379787] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 865.379940] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 deletion is rescheduled due to dependency. [ 865.381155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.381391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.381640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.381874] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.382074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.382170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.382411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.382535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.382668] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.444198] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 865.444198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.871034] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f399be6-d049-462d-b734-b3b82f3e5515 with status ACTIVE [ 865.871369] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.871509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.871579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.871790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.871877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.872063] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.872163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.872235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.872384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.872461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.872637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.872730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.872790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.873702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.873702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.873702] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f399be6-d049-462d-b734-b3b82f3e5515 is going to be updated. [ 865.874315] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.874384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.888369] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.892399] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.892533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.892606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.892804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.892933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.893103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f399be6-d049-462d-b734-b3b82f3e5515" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.134104] env[69777]: INFO networking_nsxv3.common.synchronization [req-a0e2aec1-9d50-43be-b9d3-856c2fd136d4 req-58666504-ca3a-437c-9bc9-802a3250ea48 tempest-ServerRescueNegativeTestJSON-1534204294 tempest-ServerRescueNegativeTestJSON-1534204294-project-member] Enqueued Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_members [ 866.134217] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_members [ 866.135749] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aba63da-4cec-4d01-bddd-3245f04bb8e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.135877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.136016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.136307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.136488] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.136641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.136764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.136938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.137034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.137141] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.225876] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-812 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.226086] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-812" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.226235] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-812" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.226587] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-812" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.226865] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.227036] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.227157] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.227366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.227511] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.227710] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.227819] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.227923] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.228035] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.228200] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.228285] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.228443] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.248017] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.248017] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 866.248017] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.248017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-812" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.248017] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-1ce9c34f-37d3-4e98-a0ca-20436a9f9514 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.248017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-1ce9c34f-37d3-4e98-a0ca-20436a9f9514" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.248017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-1ce9c34f-37d3-4e98-a0ca-20436a9f9514" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.248017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-1ce9c34f-37d3-4e98-a0ca-20436a9f9514" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.248017] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ce9c34f-37d3-4e98-a0ca-20436a9f9514',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.393414] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.640621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.640790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.640856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.641087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.641184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.641455] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.641549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.641549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.641822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.641822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.641822] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 already deleted. [ 866.641941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.739779] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a0b18e56-13b9-4e91-83d5-01139dc59c47 None None] Enqueued Resource ID: df9937be-4bea-4a59-86b3-9ee8d6a429a4 with Priority: HIGHEST for action port [ 866.747121] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9937be-4bea-4a59-86b3-9ee8d6a429a4 with Priority: HIGHEST for action port [ 866.747121] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-df9937be-4bea-4a59-86b3-9ee8d6a429a4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.747121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df9937be-4bea-4a59-86b3-9ee8d6a429a4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.747121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df9937be-4bea-4a59-86b3-9ee8d6a429a4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.747121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df9937be-4bea-4a59-86b3-9ee8d6a429a4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.747121] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df9937be-4bea-4a59-86b3-9ee8d6a429a4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.753748] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.753954] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.755099] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.755099] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.755099] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.755099] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 1ce9c34f-37d3-4e98-a0ca-20436a9f9514 not found, creating... [ 866.755425] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.756073] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.756073] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.756346] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.757539] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.757539] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.757539] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.757539] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.758460] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.758460] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.758460] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 1ce9c34f-37d3-4e98-a0ca-20436a9f9514 is going to be created. [ 866.779718] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.779936] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.780081] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.780407] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.781641] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.781905] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-1ce9c34f-37d3-4e98-a0ca-20436a9f9514" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.816656] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.818174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.818174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.818174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.818174] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.818174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.818174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.818501] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.822017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.822017] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.822017] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.822017] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.822017] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.822017] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.822017] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.822017] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.839819] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.839978] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 866.840139] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.840311] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-196" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.840764] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-67172a39-2dec-46c5-bcd6-a8978633d18c taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.841864] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-67172a39-2dec-46c5-bcd6-a8978633d18c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.841864] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-67172a39-2dec-46c5-bcd6-a8978633d18c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.841864] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-67172a39-2dec-46c5-bcd6-a8978633d18c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.841864] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67172a39-2dec-46c5-bcd6-a8978633d18c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.896238] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.896665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.896740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.897978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.897978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.897978] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 866.936147] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.936147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.936147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.936147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.936320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.950276] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 867.247143] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df9937be-4bea-4a59-86b3-9ee8d6a429a4 [ 867.247353] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.247487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.247557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.247772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.247863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.247957] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df9937be-4bea-4a59-86b3-9ee8d6a429a4 already deleted. [ 867.248831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df9937be-4bea-4a59-86b3-9ee8d6a429a4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.345633] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.345877] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.346015] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.346375] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.346443] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.346593] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 67172a39-2dec-46c5-bcd6-a8978633d18c not found, creating... [ 867.346853] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.347036] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.347138] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.347351] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.347485] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.347761] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.347953] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.348265] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.348514] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.348727] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.348968] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 67172a39-2dec-46c5-bcd6-a8978633d18c is going to be created. [ 867.369191] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.369409] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.369543] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.369823] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.370065] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.370295] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-67172a39-2dec-46c5-bcd6-a8978633d18c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.528920] env[69777]: INFO networking_nsxv3.common.synchronization [None req-024bbbee-4796-4009-a04a-0681e661a466 None None] Enqueued Resource ID: 9abd2c65-4732-4399-8e6b-328b655fd3ea with Priority: HIGHEST for action port [ 867.529230] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9abd2c65-4732-4399-8e6b-328b655fd3ea with Priority: HIGHEST for action port [ 867.529940] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9abd2c65-4732-4399-8e6b-328b655fd3ea taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.530154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9abd2c65-4732-4399-8e6b-328b655fd3ea" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.530264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9abd2c65-4732-4399-8e6b-328b655fd3ea" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.530544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9abd2c65-4732-4399-8e6b-328b655fd3ea" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.530632] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9abd2c65-4732-4399-8e6b-328b655fd3ea',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.758206] env[69777]: INFO networking_nsxv3.common.synchronization [req-3d8c95f0-d59d-4c4c-82bc-71bb1e196911 req-f687ff5e-bb07-46e5-8b34-64c09b51f632 service nova] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_rules [ 867.760435] env[69777]: INFO networking_nsxv3.common.synchronization [req-3d8c95f0-d59d-4c4c-82bc-71bb1e196911 req-f687ff5e-bb07-46e5-8b34-64c09b51f632 service nova] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 867.763190] env[69777]: INFO networking_nsxv3.common.synchronization [req-3d8c95f0-d59d-4c4c-82bc-71bb1e196911 req-f687ff5e-bb07-46e5-8b34-64c09b51f632 service nova] Enqueued Resource ID: 1ce9c34f-37d3-4e98-a0ca-20436a9f9514 with Priority: HIGHEST for action port [ 867.763190] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_rules [ 867.763190] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 867.763190] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce9c34f-37d3-4e98-a0ca-20436a9f9514 with Priority: HIGHEST for action port [ 867.763190] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.763190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.763190] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.765922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.766216] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ce9c34f-37d3-4e98-a0ca-20436a9f9514 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.766332] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ce9c34f-37d3-4e98-a0ca-20436a9f9514" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.766398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ce9c34f-37d3-4e98-a0ca-20436a9f9514" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.766602] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ce9c34f-37d3-4e98-a0ca-20436a9f9514" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.766693] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ce9c34f-37d3-4e98-a0ca-20436a9f9514',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.033033] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9abd2c65-4732-4399-8e6b-328b655fd3ea [ 868.033033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.034141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.034194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.034440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.034543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.034636] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9abd2c65-4732-4399-8e6b-328b655fd3ea already deleted. [ 868.035176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9abd2c65-4732-4399-8e6b-328b655fd3ea" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.268608] env[69777]: INFO networking_nsxv3.common.synchronization [req-a0e2aec1-9d50-43be-b9d3-856c2fd136d4 req-4377d582-887e-4bad-8bbc-f8118fb90272 service nova] Enqueued Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_rules [ 868.268608] env[69777]: INFO networking_nsxv3.common.synchronization [req-a0e2aec1-9d50-43be-b9d3-856c2fd136d4 req-4377d582-887e-4bad-8bbc-f8118fb90272 service nova] Enqueued Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_members [ 868.268608] env[69777]: INFO networking_nsxv3.common.synchronization [req-a0e2aec1-9d50-43be-b9d3-856c2fd136d4 req-4377d582-887e-4bad-8bbc-f8118fb90272 service nova] Enqueued Resource ID: 67172a39-2dec-46c5-bcd6-a8978633d18c with Priority: HIGHEST for action port [ 868.268608] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_rules [ 868.268608] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_members [ 868.268608] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67172a39-2dec-46c5-bcd6-a8978633d18c with Priority: HIGHEST for action port [ 868.268608] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.268608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.268608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.268608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.268608] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.273036] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aba63da-4cec-4d01-bddd-3245f04bb8e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.273036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.273036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.273036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.273036] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.273036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.273036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.273036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.273036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.273036] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.273557] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-67172a39-2dec-46c5-bcd6-a8978633d18c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.273719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67172a39-2dec-46c5-bcd6-a8978633d18c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.273787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67172a39-2dec-46c5-bcd6-a8978633d18c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.274122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67172a39-2dec-46c5-bcd6-a8978633d18c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.274122] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67172a39-2dec-46c5-bcd6-a8978633d18c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.275315] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ce9c34f-37d3-4e98-a0ca-20436a9f9514 with status ACTIVE [ 868.275488] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.275592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.275661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.275838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.275928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.276177] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.276247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.276286] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.276432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.276515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.281057] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.281227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.281303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.281485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.281570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.281664] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ce9c34f-37d3-4e98-a0ca-20436a9f9514 is going to be updated. [ 868.310661] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.310864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.310970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.311233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.311409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.311600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ce9c34f-37d3-4e98-a0ca-20436a9f9514" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.775755] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.776966] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aba63da-4cec-4d01-bddd-3245f04bb8e3 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.777091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.783902] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67172a39-2dec-46c5-bcd6-a8978633d18c with status ACTIVE [ 868.784174] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.784306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.784372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.784592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.784687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.784883] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.784957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.784998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.785163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.785434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.785492] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.785588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.785657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.785789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.785860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.785941] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67172a39-2dec-46c5-bcd6-a8978633d18c is going to be updated. [ 868.811694] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.811847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.811886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.812498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.812498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.812498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67172a39-2dec-46c5-bcd6-a8978633d18c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.970032] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 868.970032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.970032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.970032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.970032] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.970032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.970032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.970032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.970032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.970032] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.278781] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.360279] env[69777]: INFO networking_nsxv3.common.synchronization [None req-d527b468-3fc9-42a0-88c5-ebe080aa439c None None] Enqueued Resource ID: e2f3475c-72f6-4fd3-bd74-7f035eb742bf with Priority: HIGHEST for action port [ 869.360723] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f3475c-72f6-4fd3-bd74-7f035eb742bf with Priority: HIGHEST for action port [ 869.361103] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2f3475c-72f6-4fd3-bd74-7f035eb742bf taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.361225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2f3475c-72f6-4fd3-bd74-7f035eb742bf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.361225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2f3475c-72f6-4fd3-bd74-7f035eb742bf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.361940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2f3475c-72f6-4fd3-bd74-7f035eb742bf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.362041] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2f3475c-72f6-4fd3-bd74-7f035eb742bf',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.476092] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.782595] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.782914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.782914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.783087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.783176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.783290] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 is going to be created. [ 869.817558] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.817880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.817880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.818072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.818316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.828061] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 in Status: UNINITIALIZED for 2s [ 869.867338] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2f3475c-72f6-4fd3-bd74-7f035eb742bf [ 869.867338] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.867338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.867338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.867338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.867338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.867338] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2f3475c-72f6-4fd3-bd74-7f035eb742bf already deleted. [ 869.867338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2f3475c-72f6-4fd3-bd74-7f035eb742bf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.983787] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.485531] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.485722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.485796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.485998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.486099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.486198] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 870.515133] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.515398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.515473] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.515693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.515841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.524235] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 871.839475] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 in Status: SUCCESS [ 871.839475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.839475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.839475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.839475] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.839475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.840306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.840306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.840306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.840306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.840306] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.194804] env[69777]: INFO networking_nsxv3.common.synchronization [req-0ecb7310-fd35-4cb6-bc2f-77b102b11839 req-6229e6d4-c834-4ec9-ac20-824b5d25884e tempest-ServersAdminNegativeTestJSON-1845497165 tempest-ServersAdminNegativeTestJSON-1845497165-project-member] Enqueued Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 872.195602] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGHEST for action security_group_members [ 872.196042] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.196254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.197027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.197027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.197027] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.197027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.197027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.197027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.197324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.197324] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.316864] env[69777]: INFO networking_nsxv3.common.synchronization [req-2688e306-46ca-4267-b056-663d27f94079 req-c1408c9d-6a5b-456a-9861-3bfb9e7b3431 tempest-FloatingIPsAssociationTestJSON-955441248 tempest-FloatingIPsAssociationTestJSON-955441248-project-member] Enqueued Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 872.317442] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 872.317748] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.318140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.318140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.318591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.318763] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.318871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.318936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.319741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.319886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.321018] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.342913] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.533940] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 872.534132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.534755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.534896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.535105] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.535228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.535289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.535445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.535525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.535610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.535707] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.536570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.536736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.536887] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.536986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.537071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.537216] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.537320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.537417] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.699526] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.699716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.699770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.699986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.700091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.700459] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.700459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.700459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.700628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.700703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.700794] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 is going to be updated. [ 872.726773] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-474 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.726982] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.727182] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.727398] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.727628] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.727786] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.727904] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.728479] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.728637] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.728965] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.729386] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.729519] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.729637] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.729763] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 872.729973] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.730326] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.732198] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.732314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.732387] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.732550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.732688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.746813] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: IN_PROGRESS for 2s [ 872.758959] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.758959] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 872.759314] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.759314] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-474" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.759599] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-c16f8833-134e-44e5-908d-f088e284646f taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.760634] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-c16f8833-134e-44e5-908d-f088e284646f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.760634] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-c16f8833-134e-44e5-908d-f088e284646f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.760634] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-c16f8833-134e-44e5-908d-f088e284646f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.760634] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c16f8833-134e-44e5-908d-f088e284646f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.821685] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.844843] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9aba63da-4cec-4d01-bddd-3245f04bb8e3: rpc.has_security_group_logging(os_id): False [ 872.862400] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.863022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.863022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.863022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.863022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.863212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.863271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.863313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.863467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.863558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.863645] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 is going to be created. [ 872.921222] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.921460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.921460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.921629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.921875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.931021] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 in Status: IN_PROGRESS for 2s [ 873.043760] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.043913] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.044095] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.262652] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.262956] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.263194] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.266093] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.266093] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.266093] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port c16f8833-134e-44e5-908d-f088e284646f not found, creating... [ 873.266093] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.266093] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.266093] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.266093] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.266093] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.266093] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.266093] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.266482] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.266482] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.266482] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.266482] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: c16f8833-134e-44e5-908d-f088e284646f is going to be created. [ 873.312329] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.312619] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.312787] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.313108] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.313389] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.313675] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-c16f8833-134e-44e5-908d-f088e284646f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.326813] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.483997] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a056e4b-7c87-41f2-b844-3b7a09dbf4b8 req-18e73a8d-7f13-4fb4-8a51-d8f10ede3097 tempest-ServersTestBootFromVolume-1880680884 tempest-ServersTestBootFromVolume-1880680884-project-member] Enqueued Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_members [ 873.484604] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47227221-8e24-429f-b3e4-917bd42f6a48 with Priority: HIGHEST for action security_group_members [ 873.484904] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-47227221-8e24-429f-b3e4-917bd42f6a48 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.485033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.485092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.485287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.485471] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.485588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.487521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.487748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.487846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.487953] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47227221-8e24-429f-b3e4-917bd42f6a48',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.549548] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.831520] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.831668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.831764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.832052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.832174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.832296] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 is going to be updated. [ 873.876563] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.876842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.876842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.877050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.877201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.898331] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: IN_PROGRESS for 2s [ 873.990928] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.991115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.991268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.991444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.991556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.991930] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.991930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.991930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.992155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.992155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.992220] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47227221-8e24-429f-b3e4-917bd42f6a48 is going to be updated. [ 874.016768] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.017055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.017055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.018039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.018039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.025695] env[69777]: INFO networking_nsxv3.common.synchronization [req-653aeebb-9857-4c05-9ff2-11afb440d9a4 req-0e39a58f-d106-4549-895c-421454e026f3 tempest-ServersWithSpecificFlavorTestJSON-1722080042 tempest-ServersWithSpecificFlavorTestJSON-1722080042-project-member] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 874.026398] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 874.026812] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.026940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.027015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.027435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.028035] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.028035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.028035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.028035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.028559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.028559] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.032650] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47227221-8e24-429f-b3e4-917bd42f6a48 in Status: IN_PROGRESS for 2s [ 874.055520] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.055520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.055890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.057653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.057653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.057653] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 874.096693] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.096863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.096934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.097254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.097405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.106445] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 874.277597] env[69777]: INFO networking_nsxv3.common.synchronization [req-2688e306-46ca-4267-b056-663d27f94079 req-b3ae42f1-5107-48cb-a79a-60bbf49c1af5 service nova] Enqueued Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_rules [ 874.277733] env[69777]: INFO networking_nsxv3.common.synchronization [req-2688e306-46ca-4267-b056-663d27f94079 req-b3ae42f1-5107-48cb-a79a-60bbf49c1af5 service nova] Enqueued Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 874.278081] env[69777]: INFO networking_nsxv3.common.synchronization [req-2688e306-46ca-4267-b056-663d27f94079 req-b3ae42f1-5107-48cb-a79a-60bbf49c1af5 service nova] Enqueued Resource ID: c16f8833-134e-44e5-908d-f088e284646f with Priority: HIGHEST for action port [ 874.278444] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_rules [ 874.278633] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 874.278682] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16f8833-134e-44e5-908d-f088e284646f with Priority: HIGHEST for action port [ 874.279548] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.281017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.281103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.281385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.281499] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.285023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.285641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.285641] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-c16f8833-134e-44e5-908d-f088e284646f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.285641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c16f8833-134e-44e5-908d-f088e284646f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.285641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c16f8833-134e-44e5-908d-f088e284646f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.285833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c16f8833-134e-44e5-908d-f088e284646f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.285833] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c16f8833-134e-44e5-908d-f088e284646f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.531216] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.531435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.531435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.531674] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.531747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.531943] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.532076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.532131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.532253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.532338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.532439] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 is going to be updated. [ 874.559589] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.559589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.559589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.559589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.562319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.570879] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: IN_PROGRESS for 2s [ 874.757505] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 in Status: SUCCESS [ 874.758107] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 deletion is rescheduled due to dependency. [ 874.758107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.787510] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.787634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.787888] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c16f8833-134e-44e5-908d-f088e284646f with status ACTIVE [ 874.788754] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.788754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.788754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.788754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.788754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.789268] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.789268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.789268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.789268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.789268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.789419] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.789419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.789548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.791262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.791262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.791262] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c16f8833-134e-44e5-908d-f088e284646f is going to be updated. [ 874.825414] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.825594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.825663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.825885] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.826054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.826223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c16f8833-134e-44e5-908d-f088e284646f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.946738] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 in Status: SUCCESS [ 874.946987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.908049] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: SUCCESS [ 875.908601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.908936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.909758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.909758] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.909758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.909758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.910045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.910122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.910270] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.044090] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47227221-8e24-429f-b3e4-917bd42f6a48 in Status: SUCCESS [ 876.044467] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47227221-8e24-429f-b3e4-917bd42f6a48 deletion is rescheduled due to dependency. [ 876.044535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47227221-8e24-429f-b3e4-917bd42f6a48" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.117037] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 876.117312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.118029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.118029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.118029] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.118391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.118442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.119666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.119666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.119666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.119666] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.119666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.119666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.119666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.120160] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.120160] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.120160] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.120160] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.120325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.120325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.120378] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.415558] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.580175] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: SUCCESS [ 876.580175] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 deletion is rescheduled due to dependency. [ 876.580425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.623023] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32fe634d-ef8d-4778-9848-21e31e366d13: rpc.has_security_group_logging(os_id): False [ 876.639748] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.639748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.639748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.639981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.640088] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.640305] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.640409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.640527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.640717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.640799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.640972] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.641082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.641137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.641280] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.641439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.641523] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.641751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.641839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.641962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.642049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.642137] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 876.712403] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.712609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.712691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.712955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.713165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.730874] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 876.921044] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.428358] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.428759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.428759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.428849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.428927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.429057] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 is going to be updated. [ 877.458946] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.459080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.459149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.459434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.459598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.469737] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: IN_PROGRESS for 2s [ 877.780814] env[69777]: INFO networking_nsxv3.common.synchronization [req-6085535c-f1a3-4007-b55e-210ec24d3664 req-bfdbe0d7-cfc4-4dcc-87a4-f638646c352b tempest-ServersTestMultiNic-1821210824 tempest-ServersTestMultiNic-1821210824-project-member] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 877.781464] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 877.781747] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.781874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.781976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.782157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.782308] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.782409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.782472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.782616] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.782699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.782791] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.012858] env[69777]: INFO networking_nsxv3.common.synchronization [req-6085535c-f1a3-4007-b55e-210ec24d3664 req-0428c88a-d51f-452b-880f-07265d36642b tempest-ServersTestMultiNic-1821210824 tempest-ServersTestMultiNic-1821210824-project-member] Enqueued Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 878.013429] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32fe634d-ef8d-4778-9848-21e31e366d13 with Priority: HIGHEST for action security_group_members [ 878.013723] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-32fe634d-ef8d-4778-9848-21e31e366d13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.013820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.285126] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.744328] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 878.744662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.744914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.745675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.745675] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.756616] env[69777]: INFO networking_nsxv3.common.synchronization [req-85f6b877-0d4d-4e04-ae57-64cdafe69d19 req-4db86f85-1654-4cbb-b4ec-eade437c2de9 tempest-VolumesAssistedSnapshotsTest-134890089 tempest-VolumesAssistedSnapshotsTest-134890089-project-member] Enqueued Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_members [ 878.756719] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 with Priority: HIGHEST for action security_group_members [ 878.756997] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1512ec-3cb3-4a3e-9626-035d7eea4067 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.757632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.757632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.757699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.758047] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.758047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.758047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.759294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.759294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.759294] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c1512ec-3cb3-4a3e-9626-035d7eea4067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.787782] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.260187] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.260472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.260472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.260751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.260865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.261125] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.261269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.261350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.261571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.261652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.261751] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 is going to be updated. [ 879.274609] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.279023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.279023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.279023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.279023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.279023] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be deleted. [ 879.289798] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.289798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.289798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.289798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.289798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.291887] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.291887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.291887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.291887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.291887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.291887] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be updated. [ 879.298665] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 in Status: IN_PROGRESS for 2s [ 879.329273] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.329782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.329863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.330172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.330298] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.334861] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.335043] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.335195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.335476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.335619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.335816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.339925] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: IN_PROGRESS for 2s [ 879.480216] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: SUCCESS [ 879.481344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.482111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.484019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.484019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.484019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.484019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.484019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.484019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.484019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.484019] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.986793] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.987110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.987110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.987272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.987443] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.987543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.987603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.987760] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.987837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.987923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.988100] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.988225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.988332] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.988429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.988581] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.988667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.988724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.988857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.988925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.989009] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.989101] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.494582] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf27a656-ea7d-4a2d-b6f9-fe71cbf46653: rpc.has_security_group_logging(os_id): False [ 880.511494] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.511494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.511701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.513169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.513169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.513169] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.513169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.513169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.513169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.513169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.513169] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.513169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.513169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.513169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.513169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.513585] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.513585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.513585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.513585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.513585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.513724] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 is going to be updated. [ 880.570861] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.571049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.571130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.571343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.571493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.585882] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: IN_PROGRESS for 2s [ 881.308185] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 in Status: SUCCESS [ 881.308185] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1512ec-3cb3-4a3e-9626-035d7eea4067 deletion is rescheduled due to dependency. [ 881.308185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1512ec-3cb3-4a3e-9626-035d7eea4067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.349018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32fe634d-ef8d-4778-9848-21e31e366d13 in Status: SUCCESS [ 881.349253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.349422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.349640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.349895] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.349968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.350012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.350173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.350244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.350517] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32fe634d-ef8d-4778-9848-21e31e366d13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.853327] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.853842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.853842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.853842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.853842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.854027] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.854114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.854174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.854371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.854415] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.854476] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32fe634d-ef8d-4778-9848-21e31e366d13 is going to be deleted. [ 881.885903] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.886063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.886129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.886379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.886491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.886619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32fe634d-ef8d-4778-9848-21e31e366d13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.598094] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: SUCCESS [ 882.598392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.757809] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 883.758083] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 884.836151] env[69777]: INFO networking_nsxv3.common.synchronization [req-80936271-163c-4d4f-a93e-8a84f3150b69 req-f1b42c28-ea7e-4df4-943e-12cad5c6beb6 tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 884.836151] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 884.836151] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.836151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.836151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.836151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.836151] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.836901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.837105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.837402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.837588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.837768] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.873231] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.873231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.873231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.873231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.873231] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.269037] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.269271] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-58" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.269413] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-58" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.269883] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-58" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.270439] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.270610] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.270742] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.271011] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.271128] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.271343] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.271451] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.271553] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.271655] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.271772] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.271872] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.271997] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.294397] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.294572] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.294713] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.294886] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-58" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.295217] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.295388] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.295510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.295816] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.295957] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2657c1a-07a4-4c68-86f5-4fceb0e835b9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.339984] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.340239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.340366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.340687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.340929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.341163] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.341335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.341452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.341714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.341850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.342018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 already deleted. [ 885.342166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.374850] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.798561] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.798809] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.798966] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.799281] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.799452] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.799612] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port b2657c1a-07a4-4c68-86f5-4fceb0e835b9 not found, creating... [ 885.799869] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.800034] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.800156] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.800369] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.800516] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.800793] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.800947] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.801087] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.801296] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.801439] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.801578] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: b2657c1a-07a4-4c68-86f5-4fceb0e835b9 is going to be created. [ 885.820801] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.821022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.821152] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.821447] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.821670] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.821890] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.880439] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.384808] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 886.384915] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 886.683480] env[69777]: INFO networking_nsxv3.common.synchronization [req-80936271-163c-4d4f-a93e-8a84f3150b69 req-9c4a1b7b-61b5-4177-930e-e0adc8dff2bb service nova] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_rules [ 886.683652] env[69777]: INFO networking_nsxv3.common.synchronization [req-80936271-163c-4d4f-a93e-8a84f3150b69 req-9c4a1b7b-61b5-4177-930e-e0adc8dff2bb service nova] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 886.683794] env[69777]: INFO networking_nsxv3.common.synchronization [req-80936271-163c-4d4f-a93e-8a84f3150b69 req-9c4a1b7b-61b5-4177-930e-e0adc8dff2bb service nova] Enqueued Resource ID: b2657c1a-07a4-4c68-86f5-4fceb0e835b9 with Priority: HIGHEST for action port [ 886.684048] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_rules [ 886.684181] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 886.684277] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2657c1a-07a4-4c68-86f5-4fceb0e835b9 with Priority: HIGHEST for action port [ 886.685034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.685148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.685148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.685312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.685387] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.689158] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.689158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.689158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.689158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.689158] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.689158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.689158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.689158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.689158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.689158] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.689158] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.691184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.691307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.691411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.691488] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2657c1a-07a4-4c68-86f5-4fceb0e835b9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.196516] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.198026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.198026] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.198357] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2657c1a-07a4-4c68-86f5-4fceb0e835b9 with status ACTIVE [ 887.198648] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.198763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.198837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.199073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.199169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.199526] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.199526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.199526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.199656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.199859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.199928] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.200028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.200083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.200185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.200262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.200346] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2657c1a-07a4-4c68-86f5-4fceb0e835b9 is going to be updated. [ 887.223195] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.223459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.223459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.223652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.223790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.223948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.238538] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.238717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.238787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.239024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.250882] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 887.251760] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.252821] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 887.361506] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.361768] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.361907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.362271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.373574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.374517] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 887.374684] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 887.374845] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 887.409194] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.409194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.409371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.409468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.410809] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.410987] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 887.470681] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.470871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.470938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.471147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.471376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.473551] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 887.538791] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.538791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.538791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.538791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.538791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.538791] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 887.538791] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7ceaf97c-1feb-4a95-a759-71b6308c5c38', '76f2530c-f805-4944-9fb5-070cda7bf623', '4cb60d30-acd9-42ec-9942-d71d6c7c14f6', '9aba63da-4cec-4d01-bddd-3245f04bb8e3', '7bf4c6ca-ca7e-4a65-b871-10c3163bd739', '19a7e89f-21d0-44aa-b9fb-f52ca92dc496', '8a1330db-f7f7-44e4-a96f-88757581f92f', 'dd51d8a4-0c41-4e95-a3e3-1f0da556ee84', '3a1bf12c-bf27-489b-97e0-b447bcaa1329', '08af296d-bf45-410a-a0dc-29f3c9a17a13', '60d3ce25-2b05-4e1b-9df6-e5f19fcd0292', 'c23d2309-9b2a-41c1-ba25-e613842d4d53', '112c73e9-a691-4970-a3cf-0bce8dd9a106', 'df000c73-dfce-4f6a-a3af-75deec8fae28', 'cc849ff0-58d8-4b9a-9f49-53853fea6a2e', 'bd70cffe-95a5-47b4-9c07-a7316a03b88a', 'af922b11-ba63-48cf-97cd-b04487c3e7f1', '21a326fc-9e4a-40d9-978f-e62a7f187043', '93fa1adf-2111-4396-9725-628f0d0149a7', '5d3eb17a-d8a9-4390-bb23-b2dd83171c7d', '4eabc2a2-99dc-4c4c-844b-193f2dc6c288', 'd2102ed9-efb2-4a2c-a170-b1e7872f4215', '472e5966-9eb6-4e5f-91b6-9f0b0df9c87e', '06bee688-2b64-4a9b-b0eb-ee4c735a9c41', '5ee1d406-4eef-4a6f-9340-fafaa839ac55', 'da769e28-4f40-46a8-9dbb-f476563409e0', '54ece09a-8f35-4152-a654-20e3b05650f5', 'dfc00e54-a878-499a-acb4-f2b1c4844df7', 'd94c1310-5466-4ce7-9d83-c7c474aa637e', '34d3f208-bbb4-4415-9934-a2683e967524', 'c31a3d66-3f9b-4509-bdc2-763f23333743', 'c0519206-80b2-42a4-bf40-fb2cb2292017', 'aa84311d-f462-487f-91c4-49b7e8315838', 'cf27a656-ea7d-4a2d-b6f9-fe71cbf46653', '9c1512ec-3cb3-4a3e-9626-035d7eea4067', '47227221-8e24-429f-b3e4-917bd42f6a48'} {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 887.539723] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 887.559147] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.559357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.559467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.559711] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.559811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.559924] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 887.559995] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 887.560101] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 887.621297] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.621501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.621576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.621794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.623587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.623920] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 887.624429] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 887.624598] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 887.624709] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 887.624821] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 887.624938] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGH for action security_group_rules [ 887.625016] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGH for action security_group_rules [ 887.625118] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGH for action security_group_rules [ 887.625208] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGH for action security_group_rules [ 887.625296] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 with Priority: HIGH for action security_group_rules [ 887.625385] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGH for action security_group_rules [ 887.625469] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a1330db-f7f7-44e4-a96f-88757581f92f with Priority: HIGH for action security_group_rules [ 887.625554] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGH for action security_group_rules [ 887.625639] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGH for action security_group_rules [ 887.625723] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 with Priority: HIGH for action security_group_rules [ 887.625807] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGH for action security_group_rules [ 887.625906] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGH for action security_group_rules [ 887.625991] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 with Priority: HIGH for action security_group_rules [ 887.626085] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGH for action security_group_rules [ 887.626172] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGH for action security_group_rules [ 887.626386] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a with Priority: HIGH for action security_group_rules [ 887.626757] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGH for action security_group_rules [ 887.626976] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGH for action security_group_rules [ 887.627099] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93fa1adf-2111-4396-9725-628f0d0149a7 with Priority: HIGH for action security_group_rules [ 887.627232] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d with Priority: HIGH for action security_group_rules [ 887.627340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.653833] env[69777]: INFO networking_nsxv3.common.synchronization [req-12f40eb7-235b-4d77-acf5-4895d392da70 req-e9e59246-3878-48f8-be25-bd56237d7fa2 tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 887.655339] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 887.655521] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGH for action security_group_rules [ 887.655637] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGH for action security_group_rules [ 887.655752] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1330db-f7f7-44e4-a96f-88757581f92f with Priority: HIGH for action security_group_rules [ 887.655852] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGH for action security_group_rules [ 887.655958] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d with Priority: HIGH for action security_group_rules [ 887.656073] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93fa1adf-2111-4396-9725-628f0d0149a7 with Priority: HIGH for action security_group_rules [ 887.656169] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 with Priority: HIGH for action security_group_rules [ 887.656296] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGH for action security_group_rules [ 887.656365] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGH for action security_group_rules [ 887.656494] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a with Priority: HIGH for action security_group_rules [ 887.656550] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 with Priority: HIGH for action security_group_rules [ 887.656616] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGH for action security_group_rules [ 887.656699] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 with Priority: HIGH for action security_group_rules [ 887.656782] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 with Priority: HIGH for action security_group_rules [ 887.656866] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGH for action security_group_rules [ 887.656964] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGH for action security_group_rules [ 887.659375] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGH for action security_group_rules [ 887.660509] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 with Priority: HIGH for action security_group_rules [ 887.660509] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f2530c-f805-4944-9fb5-070cda7bf623 with Priority: HIGH for action security_group_rules [ 887.660509] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGH for action security_group_rules [ 887.660509] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.663208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.663208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.663208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.663208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.663208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.663208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.663208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.663208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.663208] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.663208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.663208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.663208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.663855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.664042] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.666872] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.669399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.669399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.669399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.669399] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.669399] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a1330db-f7f7-44e4-a96f-88757581f92f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.669399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.669399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.669399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.669399] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a1330db-f7f7-44e4-a96f-88757581f92f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.673435] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.673659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.674055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.674055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.674145] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.677384] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.677503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.677584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.677737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.677815] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d3eb17a-d8a9-4390-bb23-b2dd83171c7d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.679199] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93fa1adf-2111-4396-9725-628f0d0149a7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.680388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.680388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.680388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.680388] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93fa1adf-2111-4396-9725-628f0d0149a7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.685030] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a326fc-9e4a-40d9-978f-e62a7f187043 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.685030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.685030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.685030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.685030] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a326fc-9e4a-40d9-978f-e62a7f187043',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.685030] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af922b11-ba63-48cf-97cd-b04487c3e7f1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.685030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.685030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.685030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.685030] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.685030] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df000c73-dfce-4f6a-a3af-75deec8fae28 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.685030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.685030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.685030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.685030] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.685841] env[69777]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 887.685841] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd70cffe-95a5-47b4-9c07-a7316a03b88a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.686190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.686190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.686190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.686524] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd70cffe-95a5-47b4-9c07-a7316a03b88a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.687245] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-112c73e9-a691-4970-a3cf-0bce8dd9a106 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.687245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.687245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.687395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.687467] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('112c73e9-a691-4970-a3cf-0bce8dd9a106',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.688361] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.688432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.688535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.688695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.688695] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.691664] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.691664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.691664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.691664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.691664] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60d3ce25-2b05-4e1b-9df6-e5f19fcd0292',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.691664] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08af296d-bf45-410a-a0dc-29f3c9a17a13 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.691664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.691664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.691664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.691664] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08af296d-bf45-410a-a0dc-29f3c9a17a13',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.692190] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.692310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.692310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.692518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.692518] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.693723] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.693804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.693874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.694033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.694106] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.694925] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.695052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.695122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.695270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.695380] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.696333] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bf4c6ca-ca7e-4a65-b871-10c3163bd739 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.696441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.696509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.696659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.696730] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bf4c6ca-ca7e-4a65-b871-10c3163bd739',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.697688] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f2530c-f805-4944-9fb5-070cda7bf623 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.697776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.697844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.697994] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.698078] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f2530c-f805-4944-9fb5-070cda7bf623',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.698305] env[69777]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 887.700255] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.700255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.700255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.700255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.700255] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.704951] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.202650] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.203058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.203058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.203149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.203343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.203473] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.203561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.203561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.204050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.204050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.204050] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 already deleted. [ 888.204050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.205166] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.205362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.205362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.205700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.205700] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.205700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.205831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.205864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.205939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.206123] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.206123] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.209213] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.209213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.209213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.209213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.209213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.209213] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 is going to be created. [ 888.238077] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-df000c73-dfce-4f6a-a3af-75deec8fae28 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.238186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.238186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.238566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.238741] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.238741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.238741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.239561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.239561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.239561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.239561] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.245191] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-af922b11-ba63-48cf-97cd-b04487c3e7f1 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.245513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.245513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.245607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.245677] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.245769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.245829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.246040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.246136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.246489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.246685] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.250022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.250022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.250022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.250172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.250313] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.250474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.250540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.250684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.250929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.251179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.251322] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.254640] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.254786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.254832] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.255348] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.255348] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.255468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.255502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.255636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.255715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.255796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.255876] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.256891] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aba63da-4cec-4d01-bddd-3245f04bb8e3 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.257195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.257195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.257281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.258032] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.258032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.258032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.258032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.258032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.258449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.258449] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.260128] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.260261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.260318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.260538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.260802] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.260802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.260922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.260965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.261083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.261145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.261206] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.262154] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.262154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.262154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.262276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.262734] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.262734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.262734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.262734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.262734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.263034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.263034] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.267598] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.267706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.267706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.267873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.268033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.269918] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.269918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.269918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.269918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.273500] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.273677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.276046] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.310480] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: UNINITIALIZED for 2s [ 888.319725] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.319807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.324774] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.324883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.330580] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.330705] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.332174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.332296] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08af296d-bf45-410a-a0dc-29f3c9a17a13 is going to be deleted. [ 888.335032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.335032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.335745] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.335863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.336578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.336678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.337424] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.341021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.341021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.341021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.341021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.341021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.343061] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.343157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.345893] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.346010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.352567] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 888.353067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.353184] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be deleted. [ 888.354077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.354281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.372023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.372162] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bf4c6ca-ca7e-4a65-b871-10c3163bd739 is going to be deleted. [ 888.376412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.376412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.392722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.392873] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a326fc-9e4a-40d9-978f-e62a7f187043 is going to be deleted. [ 888.394474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.394474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.397347] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.397435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.407571] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.407571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.437340] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.437628] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.437954] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.438584] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.438941] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.439351] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.439541] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.442666] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.442666] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.442666] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.442666] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.442666] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.442666] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.442666] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.442666] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.442666] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.444681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.444907] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a1330db-f7f7-44e4-a96f-88757581f92f is going to be deleted. [ 888.447039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.447039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.449831] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.449924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.485807] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.485926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.486855] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.487027] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 888.487172] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.487377] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.487630] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-0bdebca1-c9c0-409a-bb7e-7341298a4038 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.487791] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-0bdebca1-c9c0-409a-bb7e-7341298a4038" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.487910] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-0bdebca1-c9c0-409a-bb7e-7341298a4038" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.489435] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-0bdebca1-c9c0-409a-bb7e-7341298a4038" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.489571] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bdebca1-c9c0-409a-bb7e-7341298a4038',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.492476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.492616] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93fa1adf-2111-4396-9725-628f0d0149a7 is going to be deleted. [ 888.494083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.494287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.521233] env[69777]: INFO networking_nsxv3.common.synchronization [req-0639d916-bf06-4a80-a12a-e57a0bdd2308 req-001784c6-e8f3-400b-aee0-d8ecea203f87 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 888.521722] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 888.522039] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.522154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.522217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.522414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.522564] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.522716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.522716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.522847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.522923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.523054] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.541760] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.541846] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 112c73e9-a691-4970-a3cf-0bce8dd9a106 is going to be deleted. [ 888.543035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.543232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.595750] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.595912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.598632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.598751] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd70cffe-95a5-47b4-9c07-a7316a03b88a is going to be deleted. [ 888.599648] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.599853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.642226] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.642364] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60d3ce25-2b05-4e1b-9df6-e5f19fcd0292 is going to be deleted. [ 888.643286] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.643495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.692243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.692393] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 is going to be deleted. [ 888.693390] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.693908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.707802] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.711205] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.711282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.720031] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.720167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.731826] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.731980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.745714] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.748709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.748834] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d3eb17a-d8a9-4390-bb23-b2dd83171c7d is going to be deleted. [ 888.750185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.750405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.751932] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.752061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.767522] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.767664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.767736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.767935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.768111] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.768231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.768278] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.768481] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.768564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.768649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.768867] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.768867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.768947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.769078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.769209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.769318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.769466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.769621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.769696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.769775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.769862] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.771169] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.775055] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.775161] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.775253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.776550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.776550] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.776550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.776550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.776550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.776550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.776550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.776550] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.776550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.776550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.776550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.776550] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.776982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.776982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.776982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.776982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.776982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.777137] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.778658] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.779427] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.783327] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af922b11-ba63-48cf-97cd-b04487c3e7f1: rpc.has_security_group_logging(os_id): False [ 888.811201] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.811331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.841448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.841588] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f2530c-f805-4944-9fb5-070cda7bf623 is going to be deleted. [ 888.842529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.842736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.842824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.842942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08af296d-bf45-410a-a0dc-29f3c9a17a13" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.843116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.843267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.843346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.843460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.844113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.844290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.844377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.844493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bf4c6ca-ca7e-4a65-b871-10c3163bd739" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.844618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.844757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.845217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.845217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a326fc-9e4a-40d9-978f-e62a7f187043" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.845217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.845217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.845528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.845528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a1330db-f7f7-44e4-a96f-88757581f92f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.845528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.845667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.845667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.845828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93fa1adf-2111-4396-9725-628f0d0149a7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.845956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.846112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.846318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.846498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-112c73e9-a691-4970-a3cf-0bce8dd9a106" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.846642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.846804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.846886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.846996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd70cffe-95a5-47b4-9c07-a7316a03b88a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.847137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.847281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.847357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.847464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60d3ce25-2b05-4e1b-9df6-e5f19fcd0292" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.847587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.847726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.847830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.848904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.851750] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.851885] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.851964] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.852211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.937746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.940086] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.940086] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.940086] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.940086] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.940086] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.940086] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 is going to be updated. [ 888.971245] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.971245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.971245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.971245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.971245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.971245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d3eb17a-d8a9-4390-bb23-b2dd83171c7d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.997061] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.997061] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.997061] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.997061] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.997061] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.997061] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 0bdebca1-c9c0-409a-bb7e-7341298a4038 not found, creating... [ 888.997061] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.997061] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.998363] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.998363] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.998363] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.001835] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.001835] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.001835] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.001835] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.001835] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.001835] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 0bdebca1-c9c0-409a-bb7e-7341298a4038 is going to be created. [ 889.027637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.027971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.027971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.029070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.056253] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.056253] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.056253] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.056253] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.056253] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.056253] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-0bdebca1-c9c0-409a-bb7e-7341298a4038" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.064558] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.064685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.068776] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.069447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.082550] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 889.083218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.084204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.084976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.084976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.084976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.084976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.084976] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 is going to be updated. [ 889.086393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.086604] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.086725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.086895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f2530c-f805-4944-9fb5-070cda7bf623" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.087074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.087362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.087460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.106360] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 in Status: IN_PROGRESS for 2s [ 889.174591] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.174591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.174591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.174591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.174591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.198017] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: IN_PROGRESS for 2s [ 889.210647] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb60d30-acd9-42ec-9942-d71d6c7c14f6: rpc.has_security_group_logging(os_id): False [ 889.243127] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.244399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.244399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.244399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.248078] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df000c73-dfce-4f6a-a3af-75deec8fae28: rpc.has_security_group_logging(os_id): False [ 889.272334] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c23d2309-9b2a-41c1-ba25-e613842d4d53: rpc.has_security_group_logging(os_id): False [ 889.275067] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19a7e89f-21d0-44aa-b9fb-f52ca92dc496: rpc.has_security_group_logging(os_id): False [ 889.280651] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc849ff0-58d8-4b9a-9f49-53853fea6a2e: rpc.has_security_group_logging(os_id): False [ 889.281588] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd51d8a4-0c41-4e95-a3e3-1f0da556ee84: rpc.has_security_group_logging(os_id): False [ 889.282402] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9aba63da-4cec-4d01-bddd-3245f04bb8e3: rpc.has_security_group_logging(os_id): False [ 889.303592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.303707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.304499] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.304624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.310359] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.310956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.312100] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.312198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.312857] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.312957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.313585] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.313680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.316323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.316638] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.316777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.316856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.317071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.317157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.317253] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 is going to be updated. [ 889.318314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.318511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.352729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.353440] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.353440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.353440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.353647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.353647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.353733] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df000c73-dfce-4f6a-a3af-75deec8fae28 is going to be updated. [ 889.354848] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.355184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.379740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.380041] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.380169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.380239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.380482] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.380566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.380791] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.380891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.380988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.381115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.381190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.381367] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.381450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.381513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.381651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.381725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.381815] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e is going to be updated. [ 889.382826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.382997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.398385] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.398496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.412260] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.412361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.414252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.414504] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.414598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.414664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.414850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.414931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.415046] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 889.416008] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.416184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.462892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.463244] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.463348] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.463420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.463615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.463857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.463923] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 is going to be updated. [ 889.465250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.465458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.496336] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.496541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.506405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.506719] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.506825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.506894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.507131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.507254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.507373] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 is going to be updated. [ 889.508664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.508830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.508968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.509965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.510177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.531082] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df000c73-dfce-4f6a-a3af-75deec8fae28 in Status: IN_PROGRESS for 2s [ 889.553292] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.553448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.571074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.571074] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.571074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.571074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.571074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.571074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.571074] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.571074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.571074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.571393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.571511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.573193] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.573286] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.573352] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.573508] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.573587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.573681] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 is going to be updated. [ 889.574781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.576212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.576212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.576541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.576711] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.576861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.578392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.580036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.580339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.609940] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: IN_PROGRESS for 2s [ 889.611323] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: IN_PROGRESS for 2s [ 889.621251] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 889.774424] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.774645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.774700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.775091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.775285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.781980] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.782264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.782342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.782555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.782702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.814593] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 in Status: IN_PROGRESS for 2s [ 889.815465] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 in Status: IN_PROGRESS for 2s [ 889.820707] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.820707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.820707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.820994] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.822346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.851272] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: IN_PROGRESS for 2s [ 889.906070] env[69777]: INFO networking_nsxv3.common.synchronization [req-12f40eb7-235b-4d77-acf5-4895d392da70 req-d0d51a60-86bf-48c1-abda-fed946c7b47c service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 889.908224] env[69777]: INFO networking_nsxv3.common.synchronization [req-12f40eb7-235b-4d77-acf5-4895d392da70 req-d0d51a60-86bf-48c1-abda-fed946c7b47c service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 889.908224] env[69777]: INFO networking_nsxv3.common.synchronization [req-12f40eb7-235b-4d77-acf5-4895d392da70 req-d0d51a60-86bf-48c1-abda-fed946c7b47c service nova] Enqueued Resource ID: 0bdebca1-c9c0-409a-bb7e-7341298a4038 with Priority: HIGHEST for action port [ 889.908224] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 889.908224] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 889.908224] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bdebca1-c9c0-409a-bb7e-7341298a4038 with Priority: HIGHEST for action port [ 889.908224] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.908664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.908664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.909093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.909093] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.911113] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.911113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.911113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.911113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.915020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.915020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.915020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.915020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.915020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.915020] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.915020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bdebca1-c9c0-409a-bb7e-7341298a4038 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.915020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bdebca1-c9c0-409a-bb7e-7341298a4038" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.915020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bdebca1-c9c0-409a-bb7e-7341298a4038" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.915020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bdebca1-c9c0-409a-bb7e-7341298a4038" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.915020] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bdebca1-c9c0-409a-bb7e-7341298a4038',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.066024] env[69777]: INFO networking_nsxv3.common.synchronization [req-1216224e-8db3-47ab-98ef-a0ada755da1c req-99b3d6d0-26a3-418b-9505-1659c64a4d41 tempest-FloatingIPsAssociationTestJSON-955441248 tempest-FloatingIPsAssociationTestJSON-955441248-project-member] Enqueued Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 890.066024] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 890.066024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.066024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.066024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.066024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.066024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.066024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.066024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.066024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.066024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.066024] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.319653] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: SUCCESS [ 890.319926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.321124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.321124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.321124] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.321124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.321124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.321124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.321124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.321124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.321124] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.411447] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.411447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.416748] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.423633] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bdebca1-c9c0-409a-bb7e-7341298a4038 with status ACTIVE [ 890.423633] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.423633] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.423633] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.423633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.424364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.424364] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bdebca1-c9c0-409a-bb7e-7341298a4038 is going to be updated. [ 890.445467] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.445604] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.445674] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.445945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.446015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.446155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bdebca1-c9c0-409a-bb7e-7341298a4038" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.569837] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.589100] env[69777]: INFO networking_nsxv3.common.synchronization [req-43b1e766-ea7b-46da-a6c0-2c6469994f15 req-a3dfaa79-70c8-4319-8d42-5ab8627bc7ac tempest-ServersAdminTestJSON-1100102510 tempest-ServersAdminTestJSON-1100102510-project-member] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 890.589879] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 890.590389] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.590513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.590586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.590789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.590941] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.591057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.591124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.591276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.591363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.591461] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.822726] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.980923] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.072212] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.097217] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.118500] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 in Status: SUCCESS [ 891.118714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.205586] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: SUCCESS [ 891.205790] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 deletion is rescheduled due to dependency. [ 891.205899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.325966] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b996564e-da05-46dc-ae53-630950b9f5c4: rpc.has_security_group_logging(os_id): False [ 891.345900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.345900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.345900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.345900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.345900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.345900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.345900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.345900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.345900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.345900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.345900] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 is going to be created. [ 891.404961] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.405359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.405436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.405769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.406232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.417679] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: IN_PROGRESS for 2s [ 891.483786] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.483990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.484080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.484304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.484396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.484497] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be created. [ 891.541266] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.541400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.541483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.541684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.541842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.550378] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df000c73-dfce-4f6a-a3af-75deec8fae28 in Status: SUCCESS [ 891.550630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.551638] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: UNINITIALIZED for 2s [ 891.574763] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.574880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.574880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.575105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.575188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.575283] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 is going to be updated. [ 891.599336] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.607025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.607025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.607025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.607025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.607025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.619142] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: IN_PROGRESS for 2s [ 891.622714] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: SUCCESS [ 891.622714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.624082] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: SUCCESS [ 891.624082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.644776] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 891.646018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.833336] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 in Status: SUCCESS [ 891.833568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.834263] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 in Status: SUCCESS [ 891.834478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.866476] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: SUCCESS [ 891.866732] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.104831] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.104831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.104831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.104831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.104831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.104831] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 892.133629] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.133629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.133629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.133629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.133629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.142431] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 892.593141] env[69777]: INFO networking_nsxv3.common.synchronization [req-4b1dcdc8-89bc-44b6-934d-df6ed56da990 req-43f77826-f7cf-4652-8943-ea2a911dd431 tempest-ServerAddressesTestJSON-1802716061 tempest-ServerAddressesTestJSON-1802716061-project-member] Enqueued Resource ID: 558602f0-d46e-4c1e-9820-0cf4971db17b with Priority: HIGHEST for action security_group_members [ 892.593693] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 558602f0-d46e-4c1e-9820-0cf4971db17b with Priority: HIGHEST for action security_group_members [ 892.594009] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-558602f0-d46e-4c1e-9820-0cf4971db17b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.594192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.594192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.594439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.594601] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.595881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.595881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.595881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.595881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.595881] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('558602f0-d46e-4c1e-9820-0cf4971db17b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.036391] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-534 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.036652] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-534" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.036751] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-534" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.037070] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-534" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.037341] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.037502] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.037622] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.037837] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.038567] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.038795] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.038913] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.039228] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.039228] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.039327] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.039386] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.039523] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.058909] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.059031] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 893.059156] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.059331] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-534" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.059657] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-849f0a91-8d06-41c3-9c61-19e3c5ad06ba taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.059838] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-849f0a91-8d06-41c3-9c61-19e3c5ad06ba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.059962] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-849f0a91-8d06-41c3-9c61-19e3c5ad06ba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.060292] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-849f0a91-8d06-41c3-9c61-19e3c5ad06ba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.060441] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('849f0a91-8d06-41c3-9c61-19e3c5ad06ba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.098720] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.098902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.099024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.099317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.099491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.099708] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.099809] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.099873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.100032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.100111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.100194] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 558602f0-d46e-4c1e-9820-0cf4971db17b already deleted. [ 893.100274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.431716] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: SUCCESS [ 893.431716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.562056] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 893.562227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.562878] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.563151] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.563327] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.563660] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.563854] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.564055] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 849f0a91-8d06-41c3-9c61-19e3c5ad06ba not found, creating... [ 893.564379] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.564711] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.564876] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.565164] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.565355] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.565696] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.565906] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.566077] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.566406] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.566636] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.566854] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 849f0a91-8d06-41c3-9c61-19e3c5ad06ba is going to be created. [ 893.567940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.568126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.568297] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.568470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.568575] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.568685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.568765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.568894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.568953] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.587357] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.587571] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.587650] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.587940] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.588202] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.588597] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-849f0a91-8d06-41c3-9c61-19e3c5ad06ba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.631039] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: SUCCESS [ 893.631459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.070852] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.071609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.071609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.071609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.071609] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.071609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.071609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.071885] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.071885] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.071885] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.073058] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.073058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.073058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.073058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.073058] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.073058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.073058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.073058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.073362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.073362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.073362] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.150762] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 894.150971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.482819] env[69777]: INFO networking_nsxv3.common.synchronization [req-4b1dcdc8-89bc-44b6-934d-df6ed56da990 req-48628bb9-7ab0-410d-9eb9-63cf11287558 service nova] Enqueued Resource ID: 558602f0-d46e-4c1e-9820-0cf4971db17b with Priority: HIGHEST for action security_group_rules [ 894.482819] env[69777]: INFO networking_nsxv3.common.synchronization [req-4b1dcdc8-89bc-44b6-934d-df6ed56da990 req-48628bb9-7ab0-410d-9eb9-63cf11287558 service nova] Enqueued Resource ID: 558602f0-d46e-4c1e-9820-0cf4971db17b with Priority: HIGHEST for action security_group_members [ 894.482819] env[69777]: INFO networking_nsxv3.common.synchronization [req-4b1dcdc8-89bc-44b6-934d-df6ed56da990 req-48628bb9-7ab0-410d-9eb9-63cf11287558 service nova] Enqueued Resource ID: 849f0a91-8d06-41c3-9c61-19e3c5ad06ba with Priority: HIGHEST for action port [ 894.482819] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 558602f0-d46e-4c1e-9820-0cf4971db17b with Priority: HIGHEST for action security_group_rules [ 894.482819] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 558602f0-d46e-4c1e-9820-0cf4971db17b with Priority: HIGHEST for action security_group_members [ 894.482819] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 849f0a91-8d06-41c3-9c61-19e3c5ad06ba with Priority: HIGHEST for action port [ 894.483070] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-558602f0-d46e-4c1e-9820-0cf4971db17b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.483070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.483160] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.483802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.483802] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('558602f0-d46e-4c1e-9820-0cf4971db17b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.484281] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-558602f0-d46e-4c1e-9820-0cf4971db17b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.484466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.484466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.484607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.484726] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.484918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.484918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.485412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.485412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.485412] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('558602f0-d46e-4c1e-9820-0cf4971db17b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.486242] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-849f0a91-8d06-41c3-9c61-19e3c5ad06ba taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.486356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-849f0a91-8d06-41c3-9c61-19e3c5ad06ba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.486417] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-849f0a91-8d06-41c3-9c61-19e3c5ad06ba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.486672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-849f0a91-8d06-41c3-9c61-19e3c5ad06ba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.486672] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('849f0a91-8d06-41c3-9c61-19e3c5ad06ba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.575353] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44fd483-f70f-4a69-967b-e48536b42565: rpc.has_security_group_logging(os_id): False [ 894.599044] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.599044] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.599044] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.599044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.599910] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.600181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.601999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.601999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.601999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.601999] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be created. [ 894.672250] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.672684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.672684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.672751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.672886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.687873] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 894.988200] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-558602f0-d46e-4c1e-9820-0cf4971db17b taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.992667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.992667] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('558602f0-d46e-4c1e-9820-0cf4971db17b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.992667] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 849f0a91-8d06-41c3-9c61-19e3c5ad06ba with status ACTIVE [ 894.992667] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.992667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.992667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.992667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.992667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.992667] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.994350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.994491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.995218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.995218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.995342] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.995482] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.995566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.995755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.995863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.996012] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 849f0a91-8d06-41c3-9c61-19e3c5ad06ba is going to be updated. [ 895.017456] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.017603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.017658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.017859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.017985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.018162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-849f0a91-8d06-41c3-9c61-19e3c5ad06ba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.500544] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('558602f0-d46e-4c1e-9820-0cf4971db17b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.004625] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.005068] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.005068] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.005274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.005274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.005383] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 558602f0-d46e-4c1e-9820-0cf4971db17b is going to be created. [ 896.029192] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.029406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.029406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.029654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.029819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.039187] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 558602f0-d46e-4c1e-9820-0cf4971db17b in Status: UNINITIALIZED for 2s [ 896.697072] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 896.697072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.464511] env[69777]: INFO networking_nsxv3.common.synchronization [None req-05741022-6267-463c-97b6-8916eaebb956 tempest-ImagesOneServerNegativeTestJSON-1912736822 tempest-ImagesOneServerNegativeTestJSON-1912736822-project-member] Enqueued Resource ID: d0f8e112-57ed-4810-9fd8-03c6a9c16ea7 with Priority: HIGHEST for action security_group_rules [ 897.464511] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f8e112-57ed-4810-9fd8-03c6a9c16ea7 with Priority: HIGHEST for action security_group_rules [ 897.464511] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0f8e112-57ed-4810-9fd8-03c6a9c16ea7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.464511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0f8e112-57ed-4810-9fd8-03c6a9c16ea7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.464903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0f8e112-57ed-4810-9fd8-03c6a9c16ea7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.465762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0f8e112-57ed-4810-9fd8-03c6a9c16ea7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.465762] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0f8e112-57ed-4810-9fd8-03c6a9c16ea7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.539063] env[69777]: INFO networking_nsxv3.common.synchronization [None req-49f713e3-d39b-4565-973d-7e74b94347c5 tempest-ImagesOneServerNegativeTestJSON-1912736822 tempest-ImagesOneServerNegativeTestJSON-1912736822-project-member] Enqueued Resource ID: d0f8e112-57ed-4810-9fd8-03c6a9c16ea7 with Priority: HIGHEST for action security_group_rules [ 897.539063] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f8e112-57ed-4810-9fd8-03c6a9c16ea7 with Priority: HIGHEST for action security_group_rules [ 897.539553] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0f8e112-57ed-4810-9fd8-03c6a9c16ea7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.539807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0f8e112-57ed-4810-9fd8-03c6a9c16ea7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.985911] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.986773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.986773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.986773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.986773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.986773] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0f8e112-57ed-4810-9fd8-03c6a9c16ea7 already deleted. [ 897.986773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0f8e112-57ed-4810-9fd8-03c6a9c16ea7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.987024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0f8e112-57ed-4810-9fd8-03c6a9c16ea7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.987065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0f8e112-57ed-4810-9fd8-03c6a9c16ea7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.987528] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0f8e112-57ed-4810-9fd8-03c6a9c16ea7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.049759] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 558602f0-d46e-4c1e-9820-0cf4971db17b in Status: SUCCESS [ 898.049759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.049759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.049759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.050018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.050233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.050341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.050645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.050875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.051170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.051483] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('558602f0-d46e-4c1e-9820-0cf4971db17b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.507949] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.508334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.508334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.508432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.508949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.508949] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0f8e112-57ed-4810-9fd8-03c6a9c16ea7 already deleted. [ 898.508949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0f8e112-57ed-4810-9fd8-03c6a9c16ea7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.557339] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-558602f0-d46e-4c1e-9820-0cf4971db17b taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.557562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.557562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.557770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.557930] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.558053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.558125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.558256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.559709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.559709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.559709] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-558602f0-d46e-4c1e-9820-0cf4971db17b taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.559709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.559709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.559709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.559709] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.559709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.559709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.559709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.559709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.559709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.559709] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('558602f0-d46e-4c1e-9820-0cf4971db17b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.786359] env[69777]: INFO networking_nsxv3.common.synchronization [req-4ddaab75-88a0-4ad1-8bd2-5bfcb172ab98 req-35880763-bcc7-41af-96bb-38ff7cd7a31b tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 898.786947] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 898.788048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.788048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.788048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.788048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.788048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.788048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.788048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.788340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.788340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.788550] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.061809] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 558602f0-d46e-4c1e-9820-0cf4971db17b: rpc.has_security_group_logging(os_id): False [ 899.079578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.079733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.079796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.080033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.080123] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.080352] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.080460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.080533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.080700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.080770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.080948] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.081060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.081122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.081263] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.081336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.081521] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.081616] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.081679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.081816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.081912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.082023] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 558602f0-d46e-4c1e-9820-0cf4971db17b is going to be created. [ 899.144606] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.144817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.144817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.145105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.145295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.156518] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 558602f0-d46e-4c1e-9820-0cf4971db17b in Status: IN_PROGRESS for 2s [ 899.291357] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.291626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.291626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.291960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.291960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.292142] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.292217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.292272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.292528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.292528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.292686] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 899.323164] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.323426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.323541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.323765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.323908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.333188] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 900.016194] env[69777]: INFO networking_nsxv3.common.synchronization [req-99d32501-722f-4551-95d9-3994af788061 req-3bbf5766-93ba-42d1-9387-3a9e3f2442ef tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 900.016806] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 900.017335] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.017335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.017335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.017547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.017724] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.018220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.018292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.018528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.018588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.018677] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.521304] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.521511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.521613] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.521861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.542425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.542707] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.542828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.542891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.543145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.543315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.543370] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 900.571936] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.572155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.572155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.572371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.572573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.581111] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 900.650669] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.650901] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.651009] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.651303] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.651588] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.651842] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.651842] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.652063] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.652212] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.652426] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.652562] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.652675] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.652786] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.652900] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.653012] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.653160] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.672032] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.672082] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 900.672303] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.672414] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.672748] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-55086a00-7d4f-4e11-880b-696edfdb191c taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.672922] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-55086a00-7d4f-4e11-880b-696edfdb191c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.673062] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-55086a00-7d4f-4e11-880b-696edfdb191c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.673423] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-55086a00-7d4f-4e11-880b-696edfdb191c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.673573] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55086a00-7d4f-4e11-880b-696edfdb191c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.168198] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 558602f0-d46e-4c1e-9820-0cf4971db17b in Status: SUCCESS [ 901.168496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.176404] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.176632] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.176821] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.177047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.177205] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.177364] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 55086a00-7d4f-4e11-880b-696edfdb191c not found, creating... [ 901.177743] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.177828] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.177898] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.178137] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.178279] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.178627] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.178791] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.178914] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.179143] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.179283] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.179431] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 55086a00-7d4f-4e11-880b-696edfdb191c is going to be created. [ 901.200798] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.201042] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.201178] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.201434] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.201662] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.201894] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-55086a00-7d4f-4e11-880b-696edfdb191c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.343736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 901.343926] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 901.344085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.944022] env[69777]: INFO networking_nsxv3.common.synchronization [req-99d32501-722f-4551-95d9-3994af788061 req-3baeadb0-5048-40a8-8abd-bc9f09a30fe1 service nova] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_rules [ 901.944022] env[69777]: INFO networking_nsxv3.common.synchronization [req-99d32501-722f-4551-95d9-3994af788061 req-3baeadb0-5048-40a8-8abd-bc9f09a30fe1 service nova] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 901.944022] env[69777]: INFO networking_nsxv3.common.synchronization [req-99d32501-722f-4551-95d9-3994af788061 req-3baeadb0-5048-40a8-8abd-bc9f09a30fe1 service nova] Enqueued Resource ID: 55086a00-7d4f-4e11-880b-696edfdb191c with Priority: HIGHEST for action port [ 901.944022] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_rules [ 901.944022] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 901.944022] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55086a00-7d4f-4e11-880b-696edfdb191c with Priority: HIGHEST for action port [ 901.944022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.944022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.944022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.944022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.944022] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.946097] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.946212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.946426] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-55086a00-7d4f-4e11-880b-696edfdb191c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.946529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55086a00-7d4f-4e11-880b-696edfdb191c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.946581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55086a00-7d4f-4e11-880b-696edfdb191c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.946790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55086a00-7d4f-4e11-880b-696edfdb191c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.946865] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55086a00-7d4f-4e11-880b-696edfdb191c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.449264] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.449264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.449612] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55086a00-7d4f-4e11-880b-696edfdb191c with status ACTIVE [ 902.449704] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.449783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.449841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.450051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.450146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.450313] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.450400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.450459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.450614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.450679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.450885] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.450987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.451064] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.451183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.451254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.451337] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55086a00-7d4f-4e11-880b-696edfdb191c is going to be updated. [ 902.479500] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.479699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.479744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.479961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.480116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.480305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55086a00-7d4f-4e11-880b-696edfdb191c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.592669] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 902.592849] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 deletion is rescheduled due to dependency. [ 902.592960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.593137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.593346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.593529] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.593649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.593713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.593862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.593942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.594054] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.809937] env[69777]: INFO networking_nsxv3.common.synchronization [req-9e09be97-15e4-49ac-9918-e1c7e16e09b9 req-dce85e87-e1fc-418f-ae4a-e0649bff0a04 tempest-ImagesTestJSON-42450789 tempest-ImagesTestJSON-42450789-project-member] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 902.811592] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 902.811592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.811741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.812180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.812438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.812651] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.812800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.812899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.813288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.813430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.813569] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.098053] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.114382] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.114582] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.115337] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.115337] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.115337] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.115337] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.115557] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.115677] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.115820] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.116060] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.116151] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.116265] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.116646] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.116646] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.116646] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.116922] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.135020] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.135205] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 903.135348] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.135617] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.135829] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-c99aa184-9373-48bf-b023-585651278513 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.136033] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-c99aa184-9373-48bf-b023-585651278513" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.136120] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-c99aa184-9373-48bf-b023-585651278513" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.136510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-c99aa184-9373-48bf-b023-585651278513" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.136657] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c99aa184-9373-48bf-b023-585651278513',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.316792] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.316944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.317031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.317256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.338194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.338194] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.338194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.338194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.338194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.338194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.338194] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 903.363665] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.363841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.363873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.364103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.364244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.376794] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 903.600434] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.642022] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.642022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.642022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.642022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.642022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.642022] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port c99aa184-9373-48bf-b023-585651278513 not found, creating... [ 903.642022] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.642022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.642022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.642022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.642022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.642747] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.642747] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.642747] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.642747] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.642747] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.642747] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: c99aa184-9373-48bf-b023-585651278513 is going to be created. [ 903.664288] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.664572] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.664659] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.664919] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.665244] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.665715] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-c99aa184-9373-48bf-b023-585651278513" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.102924] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.103106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.103195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.103410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.103507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.103609] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 904.129283] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.129446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.129515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.129711] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.129858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.138385] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 904.399205] env[69777]: INFO networking_nsxv3.common.synchronization [req-9e09be97-15e4-49ac-9918-e1c7e16e09b9 req-60560742-d95b-4223-bb6c-38d82470819c service nova] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_rules [ 904.399385] env[69777]: INFO networking_nsxv3.common.synchronization [req-9e09be97-15e4-49ac-9918-e1c7e16e09b9 req-60560742-d95b-4223-bb6c-38d82470819c service nova] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 904.399528] env[69777]: INFO networking_nsxv3.common.synchronization [req-9e09be97-15e4-49ac-9918-e1c7e16e09b9 req-60560742-d95b-4223-bb6c-38d82470819c service nova] Enqueued Resource ID: c99aa184-9373-48bf-b023-585651278513 with Priority: HIGHEST for action port [ 904.400057] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_rules [ 904.400195] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 904.400286] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c99aa184-9373-48bf-b023-585651278513 with Priority: HIGHEST for action port [ 904.400567] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.400729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.400774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.400949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.401042] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.402217] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.402310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.402497] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-c99aa184-9373-48bf-b023-585651278513 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.402599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c99aa184-9373-48bf-b023-585651278513" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.402666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c99aa184-9373-48bf-b023-585651278513" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.402852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c99aa184-9373-48bf-b023-585651278513" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.402930] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c99aa184-9373-48bf-b023-585651278513',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.904595] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.904916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.904916] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c99aa184-9373-48bf-b023-585651278513 with status ACTIVE [ 904.904993] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.905104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.905169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.905374] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.905463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.905645] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.905737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.905800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.905963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.906052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.906236] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.906395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.906395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.906556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.906638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.906721] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c99aa184-9373-48bf-b023-585651278513 is going to be updated. [ 904.926713] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.927582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.927582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.927582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.927582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.927582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c99aa184-9373-48bf-b023-585651278513" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.382205] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 905.382205] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 deletion is rescheduled due to dependency. [ 905.382286] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.382475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.382594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.382779] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.382907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.382966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.383128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.383206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.383304] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.726826] env[69777]: INFO networking_nsxv3.common.synchronization [req-57305250-a26d-42ce-8aca-c9841cf8c844 req-387b4f90-5cf1-47af-a3a7-71906bcfa46b tempest-MultipleCreateTestJSON-2061516794 tempest-MultipleCreateTestJSON-2061516794-project-member] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 905.727393] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 905.727706] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.727828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.727898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.728706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.728868] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.729383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.729481] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.729655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.729964] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.729964] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.886048] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.110908] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.110908] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.110908] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.111333] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.111489] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.112752] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.112946] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.113223] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.113395] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.113620] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.113740] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.113856] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.113968] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.114092] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.114201] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.114340] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.133393] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.133575] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 906.133720] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.133899] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.134291] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-2fefb133-4644-4715-ae14-3b7114b422c6 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.134539] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-2fefb133-4644-4715-ae14-3b7114b422c6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.134611] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-2fefb133-4644-4715-ae14-3b7114b422c6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.135087] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-2fefb133-4644-4715-ae14-3b7114b422c6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.138225] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fefb133-4644-4715-ae14-3b7114b422c6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.147178] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 906.147178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.147351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.147559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.147865] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.147937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.147970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.148131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.148208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.148288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.148374] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.232024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.232878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.232878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.232878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.252039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.255018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.255018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.255018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.255018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.255018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.255018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 906.278315] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.278559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.278651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.278869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.279069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.289040] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 906.390275] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.525830] env[69777]: INFO networking_nsxv3.common.synchronization [req-2758e568-5dea-49c2-bdf9-37b6b44aace4 req-3c6e3b3e-26c6-465e-bf57-adb26b8df04d tempest-ServerAddressesTestJSON-1802716061 tempest-ServerAddressesTestJSON-1802716061-project-member] Enqueued Resource ID: 558602f0-d46e-4c1e-9820-0cf4971db17b with Priority: HIGHEST for action security_group_members [ 906.526460] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 558602f0-d46e-4c1e-9820-0cf4971db17b with Priority: HIGHEST for action security_group_members [ 906.526815] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-558602f0-d46e-4c1e-9820-0cf4971db17b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.526957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.535230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.535313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.537177] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.537177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.537177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.537177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.537177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.537177] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('558602f0-d46e-4c1e-9820-0cf4971db17b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.641341] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.641803] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.641803] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.641985] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.642166] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.642329] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 2fefb133-4644-4715-ae14-3b7114b422c6 not found, creating... [ 906.642593] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.642756] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.642879] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.643120] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.643264] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.643557] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.643718] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.643839] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.646155] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.646423] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.646719] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 2fefb133-4644-4715-ae14-3b7114b422c6 is going to be created. [ 906.655130] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.655130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.655130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.655130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.655130] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.655130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.655130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.655130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.655130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.655130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.655594] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.655594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.655594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.655594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.655801] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.655846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.655997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.656055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.656101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.656174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.656258] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.669912] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.670119] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.670243] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.670498] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.670955] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.670955] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-2fefb133-4644-4715-ae14-3b7114b422c6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.891701] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.891929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.891993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.892974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.892974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.892974] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 906.921475] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.921634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.921710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.921987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.922208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.930044] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 907.040918] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.041102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.041167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.041409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.041469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.041776] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.041776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.041883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.041990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.042070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.042162] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 558602f0-d46e-4c1e-9820-0cf4971db17b is going to be updated. [ 907.067444] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.067600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.067661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.067869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.068009] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.076288] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 558602f0-d46e-4c1e-9820-0cf4971db17b in Status: IN_PROGRESS for 2s [ 907.159156] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2102ed9-efb2-4a2c-a170-b1e7872f4215: rpc.has_security_group_logging(os_id): False [ 907.181126] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.181126] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.181126] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.181126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.181712] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.181712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.181712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.181712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.181712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.183113] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 907.250429] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.250583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.250656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.250881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.251029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.269506] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 907.374194] env[69777]: INFO networking_nsxv3.common.synchronization [req-57305250-a26d-42ce-8aca-c9841cf8c844 req-07b29e04-1621-4191-ab4d-10e9ec07f8a2 service nova] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_rules [ 907.374194] env[69777]: INFO networking_nsxv3.common.synchronization [req-57305250-a26d-42ce-8aca-c9841cf8c844 req-07b29e04-1621-4191-ab4d-10e9ec07f8a2 service nova] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 907.374194] env[69777]: INFO networking_nsxv3.common.synchronization [req-57305250-a26d-42ce-8aca-c9841cf8c844 req-07b29e04-1621-4191-ab4d-10e9ec07f8a2 service nova] Enqueued Resource ID: 2fefb133-4644-4715-ae14-3b7114b422c6 with Priority: HIGHEST for action port [ 907.374194] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_rules [ 907.374561] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 907.374762] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fefb133-4644-4715-ae14-3b7114b422c6 with Priority: HIGHEST for action port [ 907.375140] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.375459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.375666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.375949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.376135] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.377778] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.377982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.378290] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fefb133-4644-4715-ae14-3b7114b422c6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.378696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fefb133-4644-4715-ae14-3b7114b422c6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.378837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fefb133-4644-4715-ae14-3b7114b422c6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.379111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fefb133-4644-4715-ae14-3b7114b422c6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.379327] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fefb133-4644-4715-ae14-3b7114b422c6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.878911] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.878911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.882345] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fefb133-4644-4715-ae14-3b7114b422c6 with status ACTIVE [ 907.883026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.883026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.883180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.883854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.883854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.883854] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.883854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.883854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.884186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.884186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.884386] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.884540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.884606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.884744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.884832] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.884923] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fefb133-4644-4715-ae14-3b7114b422c6 is going to be updated. [ 907.906079] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.906272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.906358] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.906591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.906777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.906994] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fefb133-4644-4715-ae14-3b7114b422c6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.303167] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 908.303422] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 deletion is rescheduled due to dependency. [ 908.304193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.304193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.304193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.304193] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.304427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.304427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.305010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.305010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.305010] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.337403] env[69777]: INFO networking_nsxv3.common.synchronization [req-57305250-a26d-42ce-8aca-c9841cf8c844 req-fa22e851-40e3-4650-b883-95db669915fd tempest-MultipleCreateTestJSON-2061516794 tempest-MultipleCreateTestJSON-2061516794-project-member] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 908.337655] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 908.338717] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.338717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.754697] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.754918] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.755066] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.755335] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.755606] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.755768] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.755888] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.756127] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.756283] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.756575] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.756692] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.756806] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.756917] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.757047] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.757160] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.757296] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.777853] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.778026] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 908.778171] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.778351] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-516" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.778836] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-a9795b1d-cd4d-4a31-9a87-6289059ff16b taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.778836] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-a9795b1d-cd4d-4a31-9a87-6289059ff16b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.779057] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-a9795b1d-cd4d-4a31-9a87-6289059ff16b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.779290] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-a9795b1d-cd4d-4a31-9a87-6289059ff16b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.779441] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9795b1d-cd4d-4a31-9a87-6289059ff16b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.806602] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.939792] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 908.940682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.940682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.940682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.940682] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.941021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.941021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.941021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.941118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.941168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.941256] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.086073] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 558602f0-d46e-4c1e-9820-0cf4971db17b in Status: SUCCESS [ 909.086266] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 558602f0-d46e-4c1e-9820-0cf4971db17b deletion is rescheduled due to dependency. [ 909.086403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.281994] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 909.282270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.282991] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.283244] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.283370] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.283637] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.283784] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.283933] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port a9795b1d-cd4d-4a31-9a87-6289059ff16b not found, creating... [ 909.284205] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.284374] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.284550] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.284788] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.285182] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.285300] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.285907] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.285907] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.285907] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.285907] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.286120] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: a9795b1d-cd4d-4a31-9a87-6289059ff16b is going to be created. [ 909.307017] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.307017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.307017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.307017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.307017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.307017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-a9795b1d-cd4d-4a31-9a87-6289059ff16b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.308840] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.446048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.446048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.446048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.446048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.446278] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.446341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.446891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.446891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.446891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.446891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.446891] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.447101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.447101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.447617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.447617] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.447617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.447617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.447617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.447803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.447803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.447909] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.810705] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.810860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.810898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.811159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.811251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.811360] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 909.838208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.838409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.838409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.838753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.839112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.846642] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 909.951292] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c31a3d66-3f9b-4509-bdc2-763f23333743: rpc.has_security_group_logging(os_id): False [ 909.967268] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.967426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.967515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.967751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.967856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.968104] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.968208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.968281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.968432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.968535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.969151] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.969151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.969151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.969151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.969151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.969367] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.969412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.969467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.969617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.969695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.969795] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 909.999750] env[69777]: INFO networking_nsxv3.common.synchronization [req-57305250-a26d-42ce-8aca-c9841cf8c844 req-d351d40c-4591-4fd4-a60d-7c6f4c7a8c68 service nova] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_rules [ 909.999995] env[69777]: INFO networking_nsxv3.common.synchronization [req-57305250-a26d-42ce-8aca-c9841cf8c844 req-d351d40c-4591-4fd4-a60d-7c6f4c7a8c68 service nova] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 910.000210] env[69777]: INFO networking_nsxv3.common.synchronization [req-57305250-a26d-42ce-8aca-c9841cf8c844 req-d351d40c-4591-4fd4-a60d-7c6f4c7a8c68 service nova] Enqueued Resource ID: a9795b1d-cd4d-4a31-9a87-6289059ff16b with Priority: HIGHEST for action port [ 910.001094] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_rules [ 910.001094] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 910.001652] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9795b1d-cd4d-4a31-9a87-6289059ff16b with Priority: HIGHEST for action port [ 910.001652] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.001762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.002070] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.002149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.002390] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9795b1d-cd4d-4a31-9a87-6289059ff16b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.002503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9795b1d-cd4d-4a31-9a87-6289059ff16b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.002606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9795b1d-cd4d-4a31-9a87-6289059ff16b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.003143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9795b1d-cd4d-4a31-9a87-6289059ff16b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.003143] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9795b1d-cd4d-4a31-9a87-6289059ff16b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.024274] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.024274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.024274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.024541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.024541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.039384] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 910.504798] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9795b1d-cd4d-4a31-9a87-6289059ff16b with status ACTIVE [ 910.505083] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.505196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.505243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.505458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.505567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.505783] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.505883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.505946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.507447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.507447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.507447] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.507447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.507447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.507447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.507447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.507447] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9795b1d-cd4d-4a31-9a87-6289059ff16b is going to be updated. [ 910.527155] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.527155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.527155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.527320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.527466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.527672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9795b1d-cd4d-4a31-9a87-6289059ff16b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.856217] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 911.856622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.856843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.857138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.857415] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.861026] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.861026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.861026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.861026] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.056948] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 912.059933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.365279] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.365279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.365279] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.866487] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.369813] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.370041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.370152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.370518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.370567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.370681] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 913.420299] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.420659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.420836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.421205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.421532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.430941] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 915.002461] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 915.002790] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 915.129253] env[69777]: INFO networking_nsxv3.common.synchronization [None req-17a38249-bb7f-47ec-ae73-08c693bd76a9 None None] Enqueued Resource ID: ba1d364a-5556-45fd-ae34-442ad8ae9dca with Priority: HIGHEST for action port [ 915.129253] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba1d364a-5556-45fd-ae34-442ad8ae9dca with Priority: HIGHEST for action port [ 915.129253] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba1d364a-5556-45fd-ae34-442ad8ae9dca taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.129649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba1d364a-5556-45fd-ae34-442ad8ae9dca" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.130033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba1d364a-5556-45fd-ae34-442ad8ae9dca" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.130508] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba1d364a-5556-45fd-ae34-442ad8ae9dca" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.131804] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba1d364a-5556-45fd-ae34-442ad8ae9dca',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.443342] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 915.443903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.443903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.444015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.444187] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.444319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.444382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.444542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.444928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.444928] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.633832] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba1d364a-5556-45fd-ae34-442ad8ae9dca [ 915.634173] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.634360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.634464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.634806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.634915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.635051] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba1d364a-5556-45fd-ae34-442ad8ae9dca already deleted. [ 915.635184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba1d364a-5556-45fd-ae34-442ad8ae9dca" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.765175] env[69777]: INFO networking_nsxv3.common.synchronization [None req-76f74a26-e08c-49da-ba19-442ffca817b6 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_rules [ 915.766247] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_rules [ 915.766794] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15fc107d-52a0-4aa7-83cd-a96824b186f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.767497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.767497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.768266] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.768266] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15fc107d-52a0-4aa7-83cd-a96824b186f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.870957] env[69777]: INFO networking_nsxv3.common.synchronization [None req-bf312fc4-59fa-4def-8ddf-304435bf285b tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_rules [ 915.871083] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_rules [ 915.871293] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15fc107d-52a0-4aa7-83cd-a96824b186f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.871397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.948017] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.289246] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.289246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.289246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.289246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.289246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.289246] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 already deleted. [ 916.289246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.289246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.289246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.289744] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15fc107d-52a0-4aa7-83cd-a96824b186f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.449829] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.816097] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.816261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.816334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.816570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.816660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.816762] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 already deleted. [ 916.816848] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.956494] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.956782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.956782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.956960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.957110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.957236] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 916.989965] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.990210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.990210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.990395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.990542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.001378] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 917.881411] env[69777]: INFO networking_nsxv3.common.synchronization [None req-6842817c-68a4-485c-8e8b-3a68a5572631 None None] Enqueued Resource ID: 4302451b-834f-4ea0-b259-56af01864329 with Priority: HIGHEST for action port [ 917.882284] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4302451b-834f-4ea0-b259-56af01864329 with Priority: HIGHEST for action port [ 917.882721] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-4302451b-834f-4ea0-b259-56af01864329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.882853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4302451b-834f-4ea0-b259-56af01864329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.883491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4302451b-834f-4ea0-b259-56af01864329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.883491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4302451b-834f-4ea0-b259-56af01864329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.883491] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4302451b-834f-4ea0-b259-56af01864329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.385699] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4302451b-834f-4ea0-b259-56af01864329 [ 918.385919] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.386103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.386185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.386488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.386588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.387044] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4302451b-834f-4ea0-b259-56af01864329 already deleted. [ 918.387044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4302451b-834f-4ea0-b259-56af01864329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.012962] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 919.013336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.013713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.013713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.013966] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.014128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.014212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.014489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.014489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.014689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.016063] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.016063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.016063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.018587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.018979] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.020034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.020034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.020034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.020034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.020034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.021735] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.071039] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c6a2042-7e53-4653-8d3c-853ca0d51606 req-f7954ecd-d644-4511-887b-a194b0ee7c5b tempest-ServerActionsV293TestJSON-1792954736 tempest-ServerActionsV293TestJSON-1792954736-project-member] Enqueued Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_members [ 919.071895] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_members [ 919.072557] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4058bf2e-e500-4002-898a-0d2b9aa510e5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.073462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.073462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.073645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.073846] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.074339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.074339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.075158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.075327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.075438] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.524975] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da769e28-4f40-46a8-9dbb-f476563409e0: rpc.has_security_group_logging(os_id): False [ 919.547037] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.547037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.549248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.549572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.551254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.551254] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.551254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.551254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.551254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.551254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.551879] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.552096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.553237] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.553632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.553785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.554153] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.554375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.554478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.554713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.554859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.555081] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 919.571427] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-643 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.571662] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-643" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.571802] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-643" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.572258] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-643" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.572547] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.572742] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.572869] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.573628] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.573950] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.574249] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.574447] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.574617] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.574858] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.575064] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 919.575532] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.575843] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.579899] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.580226] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.580419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.580805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.581016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.581305] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.581528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.581631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.581920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.582032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.582173] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 already deleted. [ 919.582296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.596725] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.596942] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 919.597121] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.597315] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-643" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.597686] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-d70cb688-2636-4187-87b5-98a65d5abddc taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.598326] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-d70cb688-2636-4187-87b5-98a65d5abddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.598326] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-d70cb688-2636-4187-87b5-98a65d5abddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.598612] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-d70cb688-2636-4187-87b5-98a65d5abddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.598612] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d70cb688-2636-4187-87b5-98a65d5abddc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.616691] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.616909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.617151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.617526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.617685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.632168] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 920.105045] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.105045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.105045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.105045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.105045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.105045] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port d70cb688-2636-4187-87b5-98a65d5abddc not found, creating... [ 920.105045] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.105045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.105045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.106027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.106351] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.106814] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.107174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.107417] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.107735] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.108019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.108278] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: d70cb688-2636-4187-87b5-98a65d5abddc is going to be created. [ 920.129678] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.130299] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.130564] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.130960] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.131444] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.131841] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-d70cb688-2636-4187-87b5-98a65d5abddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.881216] env[69777]: INFO networking_nsxv3.common.synchronization [req-4174a74a-919c-4722-8e99-a93872cb5c61 req-0f078d3f-4a40-419f-9dd4-c9bae924f27e tempest-MultipleCreateTestJSON-2061516794 tempest-MultipleCreateTestJSON-2061516794-project-member] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 920.882926] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 920.882926] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.883451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.883529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.883803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.884058] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.884170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.884255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.884438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.884534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.884816] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.999599] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c6a2042-7e53-4653-8d3c-853ca0d51606 req-8f35b14f-88c1-43c2-8a3f-773e5e9411e9 service nova] Enqueued Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_rules [ 920.999599] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c6a2042-7e53-4653-8d3c-853ca0d51606 req-8f35b14f-88c1-43c2-8a3f-773e5e9411e9 service nova] Enqueued Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_members [ 920.999599] env[69777]: INFO networking_nsxv3.common.synchronization [req-4c6a2042-7e53-4653-8d3c-853ca0d51606 req-8f35b14f-88c1-43c2-8a3f-773e5e9411e9 service nova] Enqueued Resource ID: d70cb688-2636-4187-87b5-98a65d5abddc with Priority: HIGHEST for action port [ 920.999599] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_rules [ 920.999599] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_members [ 920.999599] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70cb688-2636-4187-87b5-98a65d5abddc with Priority: HIGHEST for action port [ 921.000891] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4058bf2e-e500-4002-898a-0d2b9aa510e5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.001108] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.001193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.001400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.001874] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.002578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4058bf2e-e500-4002-898a-0d2b9aa510e5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.002835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.002835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.002923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.003043] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.003190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.003190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.003665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.003665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.003665] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.006044] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d70cb688-2636-4187-87b5-98a65d5abddc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.006044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d70cb688-2636-4187-87b5-98a65d5abddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.006044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d70cb688-2636-4187-87b5-98a65d5abddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.006044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d70cb688-2636-4187-87b5-98a65d5abddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.006044] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d70cb688-2636-4187-87b5-98a65d5abddc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.072925] env[69777]: INFO networking_nsxv3.common.synchronization [None req-f0539ce4-36bc-4f6b-8bbb-0ad349508fa4 None None] Enqueued Resource ID: 1a049c6d-6f2d-42fa-9d26-375ab3d2b692 with Priority: HIGHEST for action port [ 921.074169] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a049c6d-6f2d-42fa-9d26-375ab3d2b692 with Priority: HIGHEST for action port [ 921.074970] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a049c6d-6f2d-42fa-9d26-375ab3d2b692 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.075235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a049c6d-6f2d-42fa-9d26-375ab3d2b692" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.075451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a049c6d-6f2d-42fa-9d26-375ab3d2b692" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.075755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a049c6d-6f2d-42fa-9d26-375ab3d2b692" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.075984] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a049c6d-6f2d-42fa-9d26-375ab3d2b692',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.087870] env[69777]: INFO networking_nsxv3.common.synchronization [req-131f566b-e9df-4d00-8aaf-613803f49433 req-0152e324-9d71-492d-a8b7-ab48c5ec3e74 tempest-MultipleCreateTestJSON-2061516794 tempest-MultipleCreateTestJSON-2061516794-project-member] Enqueued Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 921.089116] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da769e28-4f40-46a8-9dbb-f476563409e0 with Priority: HIGHEST for action security_group_members [ 921.089598] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-da769e28-4f40-46a8-9dbb-f476563409e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.089675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.387316] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.508435] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4058bf2e-e500-4002-898a-0d2b9aa510e5 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.508605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.511949] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.511949] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d70cb688-2636-4187-87b5-98a65d5abddc with status ACTIVE [ 921.511949] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.511949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.511949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.511949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.511949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.511949] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.511949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.511949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.511949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.511949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.512501] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.512501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.512501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.512501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.512629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.512853] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d70cb688-2636-4187-87b5-98a65d5abddc is going to be updated. [ 921.532414] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.532684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.532684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.532919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.533113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.533290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d70cb688-2636-4187-87b5-98a65d5abddc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.578305] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a049c6d-6f2d-42fa-9d26-375ab3d2b692 [ 921.578667] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.578817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.578908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.580150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.580150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.580150] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a049c6d-6f2d-42fa-9d26-375ab3d2b692 already deleted. [ 921.580150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a049c6d-6f2d-42fa-9d26-375ab3d2b692" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.646668] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 921.646935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.647134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.647366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.647453] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.890159] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.014741] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.067387] env[69777]: INFO networking_nsxv3.common.synchronization [req-f2819cf7-d9e6-4963-ab90-549b6a0eb734 req-84a7dc77-d67e-4d4c-a7a4-7a40cdcf7a25 tempest-ServersNegativeTestJSON-1844530137 tempest-ServersNegativeTestJSON-1844530137-project-member] Enqueued Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 922.068186] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 922.068525] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.068630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.068869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.068933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.073062] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.073062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.073062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.073062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.073062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.073062] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.167939] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.167939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.167939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.168168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.168168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.168304] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be deleted. [ 922.219176] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.219176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.219176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.219176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.219176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.219176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.395060] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.395631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.397596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.397596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.397596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.397596] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be updated. [ 922.427454] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.427454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.427454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.427454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.427454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.435758] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: IN_PROGRESS for 2s [ 922.510490] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.510976] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.510976] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.511471] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.511673] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.511787] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.511911] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.512350] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.512567] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.512785] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.512890] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.512943] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.513141] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.513233] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.513450] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.513532] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.517821] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.517970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.518047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.518190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.518277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.518373] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 is going to be created. [ 922.548781] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.548970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.549050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.549281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.549445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.551406] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.551575] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 922.551792] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.552086] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.552549] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-4c9729f2-11f3-4ea6-ab95-380006053f65 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.552549] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-4c9729f2-11f3-4ea6-ab95-380006053f65" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.552549] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-4c9729f2-11f3-4ea6-ab95-380006053f65" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.552805] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-4c9729f2-11f3-4ea6-ab95-380006053f65" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.552912] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c9729f2-11f3-4ea6-ab95-380006053f65',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.563183] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 in Status: UNINITIALIZED for 2s [ 922.578307] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.055147] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.055371] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.055501] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.055795] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.055971] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.056137] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 4c9729f2-11f3-4ea6-ab95-380006053f65 not found, creating... [ 923.056408] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.056572] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.056692] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.056926] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.057088] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.057452] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.057570] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.057700] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.057910] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.058518] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.058842] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 4c9729f2-11f3-4ea6-ab95-380006053f65 is going to be created. [ 923.078616] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.079018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.079224] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.079551] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.079882] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.080192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-4c9729f2-11f3-4ea6-ab95-380006053f65" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.081421] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.282803] env[69777]: INFO networking_nsxv3.common.synchronization [None req-11e1799f-3f42-414a-a616-555f79f0db88 None None] Enqueued Resource ID: 763a3093-df51-46f5-9b1d-1d25b09bdffa with Priority: HIGHEST for action port [ 923.282803] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763a3093-df51-46f5-9b1d-1d25b09bdffa with Priority: HIGHEST for action port [ 923.282803] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-763a3093-df51-46f5-9b1d-1d25b09bdffa taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.282803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-763a3093-df51-46f5-9b1d-1d25b09bdffa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.282803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-763a3093-df51-46f5-9b1d-1d25b09bdffa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.283318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-763a3093-df51-46f5-9b1d-1d25b09bdffa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.283318] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('763a3093-df51-46f5-9b1d-1d25b09bdffa',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.583076] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.583386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.583386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.583538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.583622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.583722] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 is going to be updated. [ 923.609897] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.610083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.610178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.610459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.610617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.618374] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: IN_PROGRESS for 2s [ 923.789590] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 763a3093-df51-46f5-9b1d-1d25b09bdffa [ 923.789812] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.789962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.790063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.790296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.790438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.790514] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:763a3093-df51-46f5-9b1d-1d25b09bdffa already deleted. [ 923.790599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-763a3093-df51-46f5-9b1d-1d25b09bdffa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.290150] env[69777]: INFO networking_nsxv3.common.synchronization [req-f2819cf7-d9e6-4963-ab90-549b6a0eb734 req-08161ec6-af32-4867-a681-5e208e86a330 service nova] Enqueued Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_rules [ 924.290242] env[69777]: INFO networking_nsxv3.common.synchronization [req-f2819cf7-d9e6-4963-ab90-549b6a0eb734 req-08161ec6-af32-4867-a681-5e208e86a330 service nova] Enqueued Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 924.290363] env[69777]: INFO networking_nsxv3.common.synchronization [req-f2819cf7-d9e6-4963-ab90-549b6a0eb734 req-08161ec6-af32-4867-a681-5e208e86a330 service nova] Enqueued Resource ID: 4c9729f2-11f3-4ea6-ab95-380006053f65 with Priority: HIGHEST for action port [ 924.290895] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_rules [ 924.293448] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 924.293448] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c9729f2-11f3-4ea6-ab95-380006053f65 with Priority: HIGHEST for action port [ 924.293706] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.295527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.295720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.298650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.298751] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.300047] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.300159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.300407] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c9729f2-11f3-4ea6-ab95-380006053f65 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.300515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c9729f2-11f3-4ea6-ab95-380006053f65" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.300579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c9729f2-11f3-4ea6-ab95-380006053f65" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.300768] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c9729f2-11f3-4ea6-ab95-380006053f65" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.300847] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c9729f2-11f3-4ea6-ab95-380006053f65',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.443505] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da769e28-4f40-46a8-9dbb-f476563409e0 in Status: SUCCESS [ 924.443752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.443929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.444941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.444941] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.444941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.444941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.444941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.444941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.444941] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da769e28-4f40-46a8-9dbb-f476563409e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.571112] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 in Status: SUCCESS [ 924.571112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.571596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.571840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.572042] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.572164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.572231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.572566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.572566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.572566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.572684] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.805162] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.805488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.805569] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c9729f2-11f3-4ea6-ab95-380006053f65 with status ACTIVE [ 924.805717] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.807218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.807298] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.807512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.807604] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.807806] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.807912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.808018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.808139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.808256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.808399] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.808493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.808557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.808728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.808814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.808889] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c9729f2-11f3-4ea6-ab95-380006053f65 is going to be updated. [ 924.832977] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.833234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.833349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.833698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.833886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.834165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c9729f2-11f3-4ea6-ab95-380006053f65" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.948152] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.948290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.948358] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.948566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.948669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.948862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.949029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.949029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.949173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.950380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.950380] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da769e28-4f40-46a8-9dbb-f476563409e0 is going to be deleted. [ 924.997996] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.998273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.998273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.998456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.998542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.998683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da769e28-4f40-46a8-9dbb-f476563409e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.079127] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.230179] env[69777]: INFO networking_nsxv3.common.synchronization [req-934a97e4-5327-4709-a54c-6e8101ebd044 req-b00e6226-ee27-4795-9c75-56fde19f3300 tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 925.235034] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 925.235034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.235034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.235034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.235034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.235034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.235034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.235034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.235034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.235034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.235034] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.581422] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4058bf2e-e500-4002-898a-0d2b9aa510e5: rpc.has_security_group_logging(os_id): False [ 925.600804] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.600993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.601059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.601274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.601369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.601624] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.601744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.601818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.602031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.602097] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.602166] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 is going to be created. [ 925.627293] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: SUCCESS [ 925.627753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.627753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.628018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.629942] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.629942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.629942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.629942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.629942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.629942] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.663324] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.663473] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.664023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.664023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.664023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.676522] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 in Status: IN_PROGRESS for 2s [ 925.737992] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.739932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.739932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.739932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.739932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.739932] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.739932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.739932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.739932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.739932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.739932] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 925.768894] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.769098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.769098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.769281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.769426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.784698] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 926.137704] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.640704] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.143808] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.144128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.144128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.144339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.146258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.146258] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 is going to be updated. [ 927.172514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.172696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.172786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.172997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.173158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.188601] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: IN_PROGRESS for 2s [ 927.687313] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 in Status: SUCCESS [ 927.687560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.795402] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 927.795402] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 deletion is rescheduled due to dependency. [ 927.795402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.034694] env[69777]: INFO networking_nsxv3.common.synchronization [None req-3698c3e2-b9d4-4072-995b-270877f3e307 None None] Enqueued Resource ID: 94409494-6dc3-404e-a677-472dd5254c09 with Priority: HIGHEST for action port [ 929.035086] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94409494-6dc3-404e-a677-472dd5254c09 with Priority: HIGHEST for action port [ 929.035788] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-94409494-6dc3-404e-a677-472dd5254c09 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.035788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94409494-6dc3-404e-a677-472dd5254c09" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.035985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94409494-6dc3-404e-a677-472dd5254c09" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.038503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94409494-6dc3-404e-a677-472dd5254c09" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.038503] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94409494-6dc3-404e-a677-472dd5254c09',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.202280] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: SUCCESS [ 929.202565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.203170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.203544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.203781] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.203939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.204043] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.204243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.204355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.204469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.204590] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.543683] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94409494-6dc3-404e-a677-472dd5254c09 [ 929.543683] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.543683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.543683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.543683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.543683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.543683] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94409494-6dc3-404e-a677-472dd5254c09 already deleted. [ 929.543683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94409494-6dc3-404e-a677-472dd5254c09" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.707763] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.707908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.707974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.708343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.708343] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.709336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.709336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.709336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.709336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.709336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.709336] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.709336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.709336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.709336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.709824] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.709824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.709824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.709824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.709824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.710179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.710179] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.715265] env[69777]: INFO networking_nsxv3.common.synchronization [req-53ec2300-04c5-4fe7-afb3-7d2e7bc840e1 req-f02bc42d-188e-402b-9233-c00ff36ffa53 tempest-ServersNegativeTestMultiTenantJSON-711646333 tempest-ServersNegativeTestMultiTenantJSON-711646333-project-member] Enqueued Resource ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 with Priority: HIGHEST for action security_group_members [ 929.715830] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 with Priority: HIGHEST for action security_group_members [ 929.716133] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.718019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.718019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.718019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.718019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.718019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.718019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.718019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.718019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.718599] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.215600] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0519206-80b2-42a4-bf40-fb2cb2292017: rpc.has_security_group_logging(os_id): False [ 930.220436] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.220568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.220669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.220887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.220986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.221222] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.221282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.221357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.221481] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.221566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.221638] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 already deleted. [ 930.221717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.234032] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.234167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.234167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.234859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.252675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.252993] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.253111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.253175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.253497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.253497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.253642] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.253745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.253808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.253950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.254108] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.254252] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.254338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.254419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.254540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.254614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.254702] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 is going to be updated. [ 930.270338] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-75 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.270538] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-75" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.270669] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-75" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.271530] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-75" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.271847] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.272033] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.272162] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.272425] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.272579] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.272789] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.272909] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.273033] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.273152] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.273267] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.273378] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.273514] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.291994] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.292237] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 930.292427] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.292660] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-75" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.293093] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-afae931d-60c9-4505-8fa7-fff3684983dc taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.293319] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-afae931d-60c9-4505-8fa7-fff3684983dc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.293456] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-afae931d-60c9-4505-8fa7-fff3684983dc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.293779] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-afae931d-60c9-4505-8fa7-fff3684983dc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.293956] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afae931d-60c9-4505-8fa7-fff3684983dc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.314684] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.315182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.315182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.315295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.315669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.327575] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: IN_PROGRESS for 2s [ 930.764248] env[69777]: INFO networking_nsxv3.common.synchronization [None req-bc7a01ec-1279-42d6-a9df-6ef2d38518d4 tempest-AttachVolumeShelveTestJSON-523183173 tempest-AttachVolumeShelveTestJSON-523183173-project-member] Enqueued Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_rules [ 930.765196] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_rules [ 930.765196] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.765733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.765733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.765733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.765733] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.797126] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.797432] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.797602] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.797958] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.798177] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.798380] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port afae931d-60c9-4505-8fa7-fff3684983dc not found, creating... [ 930.799607] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.799718] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.799897] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.800095] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.800262] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.800580] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.800747] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.800873] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.801768] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.801768] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.801768] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: afae931d-60c9-4505-8fa7-fff3684983dc is going to be created. [ 930.826270] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.826491] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.826883] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.827166] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.827166] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.827399] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-afae931d-60c9-4505-8fa7-fff3684983dc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.889478] env[69777]: INFO networking_nsxv3.common.synchronization [None req-200f2f02-cd80-472f-a3b5-74bcd07c23cb tempest-AttachVolumeShelveTestJSON-523183173 tempest-AttachVolumeShelveTestJSON-523183173-project-member] Enqueued Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_rules [ 930.890514] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_rules [ 930.890514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.890514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.059768] env[69777]: INFO networking_nsxv3.common.synchronization [None req-b5aafa0d-5323-4011-bff3-6113f9e1bcda None None] Enqueued Resource ID: 9418a317-d480-4258-8675-4f4d193d2567 with Priority: HIGHEST for action port [ 931.060776] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9418a317-d480-4258-8675-4f4d193d2567 with Priority: HIGHEST for action port [ 931.060776] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9418a317-d480-4258-8675-4f4d193d2567 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.061750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9418a317-d480-4258-8675-4f4d193d2567" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.061750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9418a317-d480-4258-8675-4f4d193d2567" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.062055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9418a317-d480-4258-8675-4f4d193d2567" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.062055] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9418a317-d480-4258-8675-4f4d193d2567',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.285976] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.285976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.285976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.285976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.285976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.285976] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 already deleted. [ 931.285976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.286471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.286471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.286471] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.568707] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9418a317-d480-4258-8675-4f4d193d2567 [ 931.568707] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.568707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.568707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.568707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.568707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.568707] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9418a317-d480-4258-8675-4f4d193d2567 already deleted. [ 931.568707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9418a317-d480-4258-8675-4f4d193d2567" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.810444] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.810444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.810444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.810634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.810835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.810835] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 already deleted. [ 931.810933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.835464] env[69777]: INFO networking_nsxv3.common.synchronization [req-53ec2300-04c5-4fe7-afb3-7d2e7bc840e1 req-14a02840-db03-43d1-8527-2838a7621357 service nova] Enqueued Resource ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 with Priority: HIGHEST for action security_group_rules [ 931.835582] env[69777]: INFO networking_nsxv3.common.synchronization [req-53ec2300-04c5-4fe7-afb3-7d2e7bc840e1 req-14a02840-db03-43d1-8527-2838a7621357 service nova] Enqueued Resource ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 with Priority: HIGHEST for action security_group_members [ 931.835730] env[69777]: INFO networking_nsxv3.common.synchronization [req-53ec2300-04c5-4fe7-afb3-7d2e7bc840e1 req-14a02840-db03-43d1-8527-2838a7621357 service nova] Enqueued Resource ID: afae931d-60c9-4505-8fa7-fff3684983dc with Priority: HIGHEST for action port [ 931.836231] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 with Priority: HIGHEST for action security_group_rules [ 931.836365] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 with Priority: HIGHEST for action security_group_members [ 931.836462] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afae931d-60c9-4505-8fa7-fff3684983dc with Priority: HIGHEST for action port [ 931.837314] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.837314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.837314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.837314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.837865] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.838760] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.838943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.839032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.839216] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.839475] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.839475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.839595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.839657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.839815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.839923] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.841520] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-afae931d-60c9-4505-8fa7-fff3684983dc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.841641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afae931d-60c9-4505-8fa7-fff3684983dc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.841720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afae931d-60c9-4505-8fa7-fff3684983dc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.841873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afae931d-60c9-4505-8fa7-fff3684983dc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.841931] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afae931d-60c9-4505-8fa7-fff3684983dc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.342849] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: SUCCESS [ 932.342849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.342849] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.343840] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afae931d-60c9-4505-8fa7-fff3684983dc with status ACTIVE [ 932.344233] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.344555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.344988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.345511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.346050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.346838] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.347170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.347322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.347582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.348625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.348857] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.349544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.349544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.349544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.349544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.351748] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afae931d-60c9-4505-8fa7-fff3684983dc is going to be updated. [ 932.352385] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.352635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.374333] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.374333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.374333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.374333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.374333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.374333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afae931d-60c9-4505-8fa7-fff3684983dc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.845199] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.348989] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.349295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.349295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.350100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.350100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.350100] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 is going to be created. [ 933.378535] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.378707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.378782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.379023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.379367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.391534] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 in Status: UNINITIALIZED for 2s [ 933.900066] env[69777]: INFO networking_nsxv3.common.synchronization [None req-6d5727fd-7c7d-4e3f-810a-408adbbd0dcb tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_rules [ 933.900810] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_rules [ 933.901756] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.901756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.901756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.901756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.902616] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf7f4ddc-ed21-4d94-8cea-71e39c933549',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.036954] env[69777]: INFO networking_nsxv3.common.synchronization [None req-6ff4e2ee-debd-4f2e-a643-a9732cff01e0 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_rules [ 934.039512] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_rules [ 934.039890] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.040308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.422536] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.422948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.422948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.422948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.424148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.424148] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 already deleted. [ 934.424148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.424148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.424148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.424148] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf7f4ddc-ed21-4d94-8cea-71e39c933549',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.947195] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.947195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.947195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.947195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.947195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.947195] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 already deleted. [ 934.947195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.401189] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 in Status: SUCCESS [ 935.401509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.401777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.401889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.402078] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.402197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.402260] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.402414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.402495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.402583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.402677] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.907786] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.907786] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.907786] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.907786] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.907786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.908784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.908784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.908784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.908784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.908784] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.966084] env[69777]: INFO networking_nsxv3.common.synchronization [req-7bd91b06-3c21-434b-82ef-3f27b3e9ae5b req-865cb01e-4287-4669-ae55-89d19f3a99c9 tempest-ServersNegativeTestJSON-1844530137 tempest-ServersNegativeTestJSON-1844530137-project-member] Enqueued Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 935.966777] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 935.966979] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.967115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.967184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.967391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.967551] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.967651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.967707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.967854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.967939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.968519] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.411091] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0: rpc.has_security_group_logging(os_id): False [ 936.429243] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.429380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.429455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.430609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.431361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.431361] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.431361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.431361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.431361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.431656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.431656] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.431776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.431836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.431963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.432046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.432237] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.432327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.432462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.432517] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.432592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.432681] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 is going to be created. [ 936.471614] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.491913] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.492118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.492165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.492370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.492726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.502176] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 in Status: IN_PROGRESS for 2s [ 936.973881] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.476996] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.476996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.476996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.477384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.477384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.477384] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 is going to be updated. [ 937.514033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.514033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.514033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.514033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.514901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.523484] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: IN_PROGRESS for 2s [ 938.515388] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 in Status: SUCCESS [ 938.515388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.535823] env[69777]: INFO networking_nsxv3.common.synchronization [req-bec947c5-e059-4eaf-80e7-fabc8a72217f req-b24b30f0-d4b4-4975-9ca2-f7bb5357ffa5 tempest-FloatingIPsAssociationTestJSON-955441248 tempest-FloatingIPsAssociationTestJSON-955441248-project-member] Enqueued Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 938.536104] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 with Priority: HIGHEST for action security_group_members [ 938.536514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.536666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.536731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.536956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.537157] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.537291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.537325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.537473] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.537559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.537663] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf27a656-ea7d-4a2d-b6f9-fe71cbf46653',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.043344] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.043344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.043507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.043719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.064949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.064949] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.064949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.064949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.064949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.068077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.068077] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 is going to be updated. [ 939.088871] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.089318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.089318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.089430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.089552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.097180] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: IN_PROGRESS for 2s [ 939.532347] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: SUCCESS [ 939.532673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.107238] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 in Status: SUCCESS [ 941.107542] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf27a656-ea7d-4a2d-b6f9-fe71cbf46653 deletion is rescheduled due to dependency. [ 941.107542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf27a656-ea7d-4a2d-b6f9-fe71cbf46653" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.388567] env[69777]: INFO networking_nsxv3.common.synchronization [None req-28420e32-50ea-45e6-926e-e6e6035c5297 None None] Enqueued Resource ID: 88163145-6c06-4ad0-be27-40af4ae9b023 with Priority: HIGHEST for action port [ 941.388954] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88163145-6c06-4ad0-be27-40af4ae9b023 with Priority: HIGHEST for action port [ 941.389678] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-88163145-6c06-4ad0-be27-40af4ae9b023 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.389905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88163145-6c06-4ad0-be27-40af4ae9b023" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.389905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88163145-6c06-4ad0-be27-40af4ae9b023" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.390291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88163145-6c06-4ad0-be27-40af4ae9b023" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.390382] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88163145-6c06-4ad0-be27-40af4ae9b023',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.892798] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88163145-6c06-4ad0-be27-40af4ae9b023 [ 941.892798] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.892798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.892798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.893102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.893102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.893209] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88163145-6c06-4ad0-be27-40af4ae9b023 already deleted. [ 941.893292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88163145-6c06-4ad0-be27-40af4ae9b023" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.369038] env[69777]: INFO networking_nsxv3.common.synchronization [req-6e08c009-ae91-46fc-8e6f-4d5865b232ef req-8fb714fd-f8fc-430e-a57d-3b0823ef9338 tempest-ServersWithSpecificFlavorTestJSON-1722080042 tempest-ServersWithSpecificFlavorTestJSON-1722080042-project-member] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 942.369671] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 942.369746] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.369874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.369908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.374274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.374274] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.374274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.374274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.374274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.374274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.374274] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.378223] env[69777]: INFO networking_nsxv3.common.synchronization [req-ac55117d-644b-4328-a322-758c89a0e550 req-dc6b15c3-dbd0-4aa5-ac30-c20aa2fe063b tempest-ServersAdminTestJSON-1100102510 tempest-ServersAdminTestJSON-1100102510-project-member] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 942.378628] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 942.379226] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.379284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.379323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.379496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.379638] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.379843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.379904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.380048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.380699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.380699] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.394285] env[69777]: INFO networking_nsxv3.common.synchronization [None req-0bfd42d0-3911-4976-9880-707203b1b5eb tempest-ServersTestManualDisk-959404340 tempest-ServersTestManualDisk-959404340-project-member] Enqueued Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_rules [ 942.394854] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_rules [ 942.395291] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad5575ce-f5cd-4af5-9757-424d93034877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.399188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.399270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.399526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.399614] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.507435] env[69777]: INFO networking_nsxv3.common.synchronization [None req-8c6a5f43-13c8-4dea-8f37-0ca1c6c6febd tempest-ServersTestManualDisk-959404340 tempest-ServersTestManualDisk-959404340-project-member] Enqueued Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_rules [ 942.507967] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_rules [ 942.508280] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad5575ce-f5cd-4af5-9757-424d93034877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.508373] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.718315] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.718801] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-14" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.719086] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-14" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.719459] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-14" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.720208] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.723389] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.723389] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.723389] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.723389] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.723389] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.723389] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.723389] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.723389] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.724813] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.724813] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.724813] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.745739] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.745925] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 942.746099] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.746288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-14" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.746743] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-a2e67591-0ee7-4844-999a-9492e6480c87 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.746978] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-a2e67591-0ee7-4844-999a-9492e6480c87" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.747132] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-a2e67591-0ee7-4844-999a-9492e6480c87" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.747463] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-a2e67591-0ee7-4844-999a-9492e6480c87" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.747607] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2e67591-0ee7-4844-999a-9492e6480c87',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.883136] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.883136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.883136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.883136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.883136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.883136] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.883136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.883136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.883136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.883510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.883510] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 is going to be deleted. [ 942.884280] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.916257] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.916257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.916257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.916257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.916257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.916257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.918438] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.918438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.918438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.918438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.918593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.918593] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad5575ce-f5cd-4af5-9757-424d93034877 already deleted. [ 942.918652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.918813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.918973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.919077] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.251035] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.251035] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.251035] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.251242] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.251325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.251486] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port a2e67591-0ee7-4844-999a-9492e6480c87 not found, creating... [ 943.251754] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.251908] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.252035] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.252254] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.252390] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.252666] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.252816] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.252932] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.253826] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.254104] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.255181] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: a2e67591-0ee7-4844-999a-9492e6480c87 is going to be created. [ 943.275366] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.275579] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.275709] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.275978] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.276230] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.276472] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-a2e67591-0ee7-4844-999a-9492e6480c87" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.389936] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.452032] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.452032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.452032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.452288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.452288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.452288] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad5575ce-f5cd-4af5-9757-424d93034877 already deleted. [ 943.452393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.670770] env[69777]: INFO networking_nsxv3.common.synchronization [None req-8107b7b2-806a-40d8-8ce8-0156997a19c8 None None] Enqueued Resource ID: f8d254a6-3876-40f3-8b3a-d97ba3308217 with Priority: HIGHEST for action port [ 943.671531] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d254a6-3876-40f3-8b3a-d97ba3308217 with Priority: HIGHEST for action port [ 943.671840] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8d254a6-3876-40f3-8b3a-d97ba3308217 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.672038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8d254a6-3876-40f3-8b3a-d97ba3308217" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.672347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8d254a6-3876-40f3-8b3a-d97ba3308217" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.672590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8d254a6-3876-40f3-8b3a-d97ba3308217" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.672678] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8d254a6-3876-40f3-8b3a-d97ba3308217',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.894085] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.894223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.894223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.894679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.894679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.894679] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 943.920365] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.920531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.920613] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.920856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.921114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.929157] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 944.040298] env[69777]: INFO networking_nsxv3.common.synchronization [req-6e08c009-ae91-46fc-8e6f-4d5865b232ef req-5eae371f-fa75-4097-8ca9-c1d18a11173c service nova] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_rules [ 944.041033] env[69777]: INFO networking_nsxv3.common.synchronization [req-6e08c009-ae91-46fc-8e6f-4d5865b232ef req-5eae371f-fa75-4097-8ca9-c1d18a11173c service nova] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 944.041033] env[69777]: INFO networking_nsxv3.common.synchronization [req-6e08c009-ae91-46fc-8e6f-4d5865b232ef req-5eae371f-fa75-4097-8ca9-c1d18a11173c service nova] Enqueued Resource ID: a2e67591-0ee7-4844-999a-9492e6480c87 with Priority: HIGHEST for action port [ 944.041033] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_rules [ 944.041033] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 944.041420] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2e67591-0ee7-4844-999a-9492e6480c87 with Priority: HIGHEST for action port [ 944.041618] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.041743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.041810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.043369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.043369] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.043369] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.043369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.043369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.043369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.043908] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.043908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.043908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.043908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.043908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.043908] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.044854] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2e67591-0ee7-4844-999a-9492e6480c87 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.044982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2e67591-0ee7-4844-999a-9492e6480c87" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.045055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2e67591-0ee7-4844-999a-9492e6480c87" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.045779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2e67591-0ee7-4844-999a-9492e6480c87" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.045779] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2e67591-0ee7-4844-999a-9492e6480c87',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.175239] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8d254a6-3876-40f3-8b3a-d97ba3308217 [ 944.175523] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.175648] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.175716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.176474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.176474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.176474] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8d254a6-3876-40f3-8b3a-d97ba3308217 already deleted. [ 944.176474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8d254a6-3876-40f3-8b3a-d97ba3308217" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.434787] env[69777]: INFO networking_nsxv3.common.synchronization [req-db2bcd5d-f277-469f-b344-5e36f83db4eb req-52fdd67c-e772-4291-accf-aa6c7f7212e0 tempest-ServersNegativeTestMultiTenantJSON-711646333 tempest-ServersNegativeTestMultiTenantJSON-711646333-project-member] Enqueued Resource ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 with Priority: HIGHEST for action security_group_members [ 944.434787] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 with Priority: HIGHEST for action security_group_members [ 944.434787] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.434787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.435987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.435987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.435987] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.435987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.435987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.435987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.436448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.436448] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.547485] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.547485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.547485] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.550790] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2e67591-0ee7-4844-999a-9492e6480c87 with status ACTIVE [ 944.550790] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.550790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.550790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.550790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.550790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.550790] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.550790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.550790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.550790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.550790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.550790] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.551678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.551678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.551678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.551678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.551678] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2e67591-0ee7-4844-999a-9492e6480c87 is going to be updated. [ 944.573031] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.573166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.573236] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.573499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.573538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.573685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2e67591-0ee7-4844-999a-9492e6480c87" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.939018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.939246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.939246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.939496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.939610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.939830] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.939950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.940089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.940166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.940259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.940349] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 is going to be updated. [ 944.968719] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.968719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.968719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.968719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.968719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.977530] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 in Status: IN_PROGRESS for 2s [ 945.022760] env[69777]: INFO networking_nsxv3.common.synchronization [req-2efdc7a4-36a0-4c5c-bb30-d1c11b1c8cd9 req-c5af1433-e485-429a-b02f-a6939b1e0795 tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 945.023327] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 945.023637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.023767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.023838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.024357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.024542] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.024657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.024726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.024876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.024962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.025069] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.048725] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.360609] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.360816] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.360961] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.361244] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.361501] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.361661] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.361781] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.362044] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.362162] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.362376] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.363198] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.363198] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.363198] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.363198] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.363198] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.363198] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.380985] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.381161] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.381302] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.381470] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.381759] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-f47bd1af-59f9-4733-8b26-e57ecb2eb92e taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.381957] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-f47bd1af-59f9-4733-8b26-e57ecb2eb92e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.382099] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-f47bd1af-59f9-4733-8b26-e57ecb2eb92e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.382397] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-f47bd1af-59f9-4733-8b26-e57ecb2eb92e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.382543] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f47bd1af-59f9-4733-8b26-e57ecb2eb92e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.527300] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.551706] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.551884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.551956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.552202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.552308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.552408] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 is going to be created. [ 945.575220] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.575390] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.575458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.575684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.575862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.589680] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: UNINITIALIZED for 2s [ 945.886217] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.886504] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.886607] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.887187] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.887404] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.887599] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port f47bd1af-59f9-4733-8b26-e57ecb2eb92e not found, creating... [ 945.887907] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.888104] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.888242] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.888533] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.888704] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.889155] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.889347] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.889447] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.889679] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.889822] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.889970] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: f47bd1af-59f9-4733-8b26-e57ecb2eb92e is going to be created. [ 945.907921] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.908162] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.908436] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.908733] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.909052] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.909940] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-f47bd1af-59f9-4733-8b26-e57ecb2eb92e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.939964] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 945.940229] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.029791] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.535712] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.535712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.535712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.535712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.535712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.535712] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 946.561701] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.561701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.561701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.561701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.561701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.568512] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 946.642475] env[69777]: INFO networking_nsxv3.common.synchronization [req-2efdc7a4-36a0-4c5c-bb30-d1c11b1c8cd9 req-7e7e4db9-6002-4aa9-8519-87790448c5a8 service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 946.642475] env[69777]: INFO networking_nsxv3.common.synchronization [req-2efdc7a4-36a0-4c5c-bb30-d1c11b1c8cd9 req-7e7e4db9-6002-4aa9-8519-87790448c5a8 service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 946.642475] env[69777]: INFO networking_nsxv3.common.synchronization [req-2efdc7a4-36a0-4c5c-bb30-d1c11b1c8cd9 req-7e7e4db9-6002-4aa9-8519-87790448c5a8 service nova] Enqueued Resource ID: f47bd1af-59f9-4733-8b26-e57ecb2eb92e with Priority: HIGHEST for action port [ 946.642475] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 946.642475] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 946.642475] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47bd1af-59f9-4733-8b26-e57ecb2eb92e with Priority: HIGHEST for action port [ 946.642475] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.643253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.643464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.643761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.644016] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.645218] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.646072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.646397] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f47bd1af-59f9-4733-8b26-e57ecb2eb92e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.646703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f47bd1af-59f9-4733-8b26-e57ecb2eb92e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.646893] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f47bd1af-59f9-4733-8b26-e57ecb2eb92e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.647272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f47bd1af-59f9-4733-8b26-e57ecb2eb92e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.647444] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f47bd1af-59f9-4733-8b26-e57ecb2eb92e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.000392] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 in Status: SUCCESS [ 947.000645] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 deletion is rescheduled due to dependency. [ 947.000807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.150602] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.150774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.150906] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f47bd1af-59f9-4733-8b26-e57ecb2eb92e with status ACTIVE [ 947.151095] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.151181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.151249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.151459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.151547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.151742] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.151818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.151861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.152033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.152114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.152293] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.152385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.152447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.152585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.152673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.152780] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f47bd1af-59f9-4733-8b26-e57ecb2eb92e is going to be updated. [ 947.172639] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.172787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.172836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.173042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.173181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.173341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f47bd1af-59f9-4733-8b26-e57ecb2eb92e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.599407] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: SUCCESS [ 947.599701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.599812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.600140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.600338] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.600466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.601033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.601033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.601033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.601033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.601033] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.103459] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.577043] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 948.577202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.577360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.577577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.577764] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.577912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.578026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.578200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.578283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.578380] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.605929] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a1bf12c-bf27-489b-97e0-b447bcaa1329: rpc.has_security_group_logging(os_id): False [ 948.622622] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.622758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.622843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.623046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.623135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.623369] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.623469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.623537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.623680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.623788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.623830] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 is going to be created. [ 948.679909] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.680120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.680209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.680458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.680696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.694730] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: IN_PROGRESS for 2s [ 949.080561] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.583938] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.086976] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.087384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.087384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.087557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.087641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.087905] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 950.116593] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.116593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.116593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.119763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.119763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.127858] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 950.706599] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: SUCCESS [ 950.706833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.643186] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 951.643544] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 952.139137] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 952.139137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.139458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.139634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.140174] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.140174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.140174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.140925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.140925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.140925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.140925] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.644313] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.644662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.644662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.644820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.644965] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.645083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.645156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.645474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.645729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.645729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.645893] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.645967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.646044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.646211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.646392] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.646488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.646551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.646706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.646775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.646847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.646950] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.149067] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06bee688-2b64-4a9b-b0eb-ee4c735a9c41: rpc.has_security_group_logging(os_id): False [ 953.166814] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.167044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.167044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.167228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.189345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.189680] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.189814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.189922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.190215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.190321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.190548] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.190699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.190770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.190968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.191108] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.191362] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.191470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.191549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.191735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.191836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.191955] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 953.270633] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.270810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.270888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.271204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.271365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.284112] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 954.620979] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f33e3c1-7506-4290-b825-a3535051f2ec req-6de386a2-6294-41d7-b9da-7fa3a15d6f52 tempest-VolumesAdminNegativeTest-1280332786 tempest-VolumesAdminNegativeTest-1280332786-project-member] Enqueued Resource ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 with Priority: HIGHEST for action security_group_members [ 954.621582] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 with Priority: HIGHEST for action security_group_members [ 954.621912] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.625412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.625552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.625827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.626036] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.626188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.626249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.626404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.626494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.626577] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7a5ca58-1bdc-49d1-821b-3e40291a7c15',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.129261] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.129533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.129663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.129924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.130051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.130362] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.130495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.130566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.130748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.130863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.130992] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 already deleted. [ 955.131142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.300117] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 955.300117] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.670110] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.670992] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-944" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.671331] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-944" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.671772] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-944" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.672514] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.672773] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.672968] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.673496] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.673540] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.673836] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.674031] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.674223] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.674400] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.674582] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.674846] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.674956] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.693454] env[69777]: INFO networking_nsxv3.common.synchronization [req-d04625f9-c65c-4599-966e-02365958e84e req-13fd7af9-d866-4c2c-b8b4-a0636f87dcd0 tempest-ServersTestFqdnHostnames-746215206 tempest-ServersTestFqdnHostnames-746215206-project-member] Enqueued Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_members [ 955.694901] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.695147] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 955.695359] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.695609] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-944" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.696308] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-e8effa54-1579-410e-8521-890dff26734b taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.696308] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-e8effa54-1579-410e-8521-890dff26734b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.696477] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-e8effa54-1579-410e-8521-890dff26734b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.696899] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-e8effa54-1579-410e-8521-890dff26734b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.697153] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8effa54-1579-410e-8521-890dff26734b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.699541] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGHEST for action security_group_members [ 955.703467] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.703639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.703741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.704025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.704259] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.704748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.704748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.704748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.704912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.704949] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.207019] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.207019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.207019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.207019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.207019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.207019] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port e8effa54-1579-410e-8521-890dff26734b not found, creating... [ 956.207019] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.207019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.207019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.207019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.207019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.207859] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.207859] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.207859] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.208604] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.208951] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.211110] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: e8effa54-1579-410e-8521-890dff26734b is going to be created. [ 956.214420] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.214420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.214420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.214420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.214420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.214420] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.214420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.214420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.214420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.214420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.214420] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 is going to be updated. [ 956.238277] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.238277] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.238277] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.238277] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.238277] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.238277] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-e8effa54-1579-410e-8521-890dff26734b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.240468] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.240813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.240993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.241312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.241558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.250663] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 in Status: IN_PROGRESS for 2s [ 957.244029] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f33e3c1-7506-4290-b825-a3535051f2ec req-acde30e3-653e-4b1f-a06b-2eadf8246817 service nova] Enqueued Resource ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 with Priority: HIGHEST for action security_group_rules [ 957.244278] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f33e3c1-7506-4290-b825-a3535051f2ec req-acde30e3-653e-4b1f-a06b-2eadf8246817 service nova] Enqueued Resource ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 with Priority: HIGHEST for action security_group_members [ 957.244329] env[69777]: INFO networking_nsxv3.common.synchronization [req-0f33e3c1-7506-4290-b825-a3535051f2ec req-acde30e3-653e-4b1f-a06b-2eadf8246817 service nova] Enqueued Resource ID: e8effa54-1579-410e-8521-890dff26734b with Priority: HIGHEST for action port [ 957.250057] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 with Priority: HIGHEST for action security_group_rules [ 957.250205] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 with Priority: HIGHEST for action security_group_members [ 957.250302] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8effa54-1579-410e-8521-890dff26734b with Priority: HIGHEST for action port [ 957.251371] env[69777]: INFO networking_nsxv3.common.synchronization [req-4bd589b4-1c61-4795-b712-41a9847b7c39 req-b04ca5cb-4209-4c50-b7a6-95dcc1c34fe2 tempest-ImagesOneServerNegativeTestJSON-1912736822 tempest-ImagesOneServerNegativeTestJSON-1912736822-project-member] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 957.251621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7a5ca58-1bdc-49d1-821b-3e40291a7c15 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.251754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.251818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.252446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.252574] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7a5ca58-1bdc-49d1-821b-3e40291a7c15',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.254787] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.254787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.254787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.254787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.254787] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.254787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.254787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.255075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.255075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.255075] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7a5ca58-1bdc-49d1-821b-3e40291a7c15',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.256272] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8effa54-1579-410e-8521-890dff26734b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.256272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8effa54-1579-410e-8521-890dff26734b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.256272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8effa54-1579-410e-8521-890dff26734b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.256272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8effa54-1579-410e-8521-890dff26734b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.256272] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8effa54-1579-410e-8521-890dff26734b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.259021] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 957.259021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.259021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.259021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.259021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.259021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.259021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.259021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.259021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.259021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.259021] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.734153] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-894 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.734909] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.734909] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.735091] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.735382] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.735633] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.735862] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.736197] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.736480] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.736793] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.737041] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.737261] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.737575] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.737797] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.737997] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.738250] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.756788] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.761141] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.761141] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.761141] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.761141] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-9093f935-e2fb-44bf-9c62-92cbd6e8ce29 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.761141] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-9093f935-e2fb-44bf-9c62-92cbd6e8ce29" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.761141] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-9093f935-e2fb-44bf-9c62-92cbd6e8ce29" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.761141] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-9093f935-e2fb-44bf-9c62-92cbd6e8ce29" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.761141] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9093f935-e2fb-44bf-9c62-92cbd6e8ce29',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.761141] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8effa54-1579-410e-8521-890dff26734b with status ACTIVE [ 957.761141] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.761141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.761141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.761745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.761745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.761745] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.761745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.761745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.761745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.761974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.761974] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.762070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.763862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.763862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.763862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.763862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8effa54-1579-410e-8521-890dff26734b is going to be updated. [ 957.763862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.763862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.763862] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7a5ca58-1bdc-49d1-821b-3e40291a7c15',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.764766] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.764873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.764931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.765101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.765176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.765343] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.765436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.765688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.765864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.765944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.766088] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be deleted. [ 957.789831] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.791966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.791966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.791966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.791966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.791966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8effa54-1579-410e-8521-890dff26734b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.797891] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.797891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.797891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.799308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.799423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.799564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.853328] env[69777]: INFO networking_nsxv3.common.synchronization [req-0e983925-9d68-454c-af31-2c10d35f99d6 req-ab85c42a-341e-4098-9c77-13252d4bdefc tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 957.853328] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 957.853328] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.853328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.853763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.854128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.854380] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.854663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.856115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.856115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.856115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.856115] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.260309] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 in Status: SUCCESS [ 958.260565] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 deletion is rescheduled due to dependency. [ 958.260618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.267377] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7a5ca58-1bdc-49d1-821b-3e40291a7c15',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.268844] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.269034] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.269183] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.269406] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.269573] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.269757] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 9093f935-e2fb-44bf-9c62-92cbd6e8ce29 not found, creating... [ 958.270053] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.270250] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.270398] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.270660] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.270818] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.271270] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.271461] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.272077] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.272077] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.272077] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.272209] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 9093f935-e2fb-44bf-9c62-92cbd6e8ce29 is going to be created. [ 958.291643] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.291862] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.291940] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.292674] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.292674] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.292798] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-9093f935-e2fb-44bf-9c62-92cbd6e8ce29" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.358138] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.774510] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.774686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.774761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.775012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.775124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.775247] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 is going to be created. [ 958.802852] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.803045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.803104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.803281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.803425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.814757] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 in Status: UNINITIALIZED for 2s [ 958.861342] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.094154] env[69777]: INFO networking_nsxv3.common.synchronization [req-4bd589b4-1c61-4795-b712-41a9847b7c39 req-9e48860d-df13-4eed-b310-78daad223161 service nova] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_rules [ 959.094354] env[69777]: INFO networking_nsxv3.common.synchronization [req-4bd589b4-1c61-4795-b712-41a9847b7c39 req-9e48860d-df13-4eed-b310-78daad223161 service nova] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 959.094498] env[69777]: INFO networking_nsxv3.common.synchronization [req-4bd589b4-1c61-4795-b712-41a9847b7c39 req-9e48860d-df13-4eed-b310-78daad223161 service nova] Enqueued Resource ID: 9093f935-e2fb-44bf-9c62-92cbd6e8ce29 with Priority: HIGHEST for action port [ 959.095624] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_rules [ 959.095624] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 959.095624] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9093f935-e2fb-44bf-9c62-92cbd6e8ce29 with Priority: HIGHEST for action port [ 959.095888] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.097208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.097208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.097429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.097820] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.099150] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.099150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.099321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.099817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.099817] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.100129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.100129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.100235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.100285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.100355] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.103049] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9093f935-e2fb-44bf-9c62-92cbd6e8ce29 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.103049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9093f935-e2fb-44bf-9c62-92cbd6e8ce29" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.103049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9093f935-e2fb-44bf-9c62-92cbd6e8ce29" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.104670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9093f935-e2fb-44bf-9c62-92cbd6e8ce29" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.104670] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9093f935-e2fb-44bf-9c62-92cbd6e8ce29',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.363845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.364235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.364235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.364447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.364568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.364697] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 959.397115] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.401450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.401601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.401855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.402051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.411061] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 959.609193] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9093f935-e2fb-44bf-9c62-92cbd6e8ce29 with status ACTIVE [ 959.609193] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.609193] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.609193] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.609193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.610079] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9093f935-e2fb-44bf-9c62-92cbd6e8ce29 is going to be updated. [ 959.611951] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.612936] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.613057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.633764] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.633885] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.633967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.634982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.635165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.635772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9093f935-e2fb-44bf-9c62-92cbd6e8ce29" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.115269] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.621014] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.621315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.621315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.621498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.621578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.621690] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be created. [ 960.645902] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.646941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.647028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.647271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.647446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.656433] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: UNINITIALIZED for 2s [ 960.826705] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 in Status: SUCCESS [ 960.826962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.827362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.827430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.827633] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.827752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.827817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.827978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.828101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.828196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.828309] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7a5ca58-1bdc-49d1-821b-3e40291a7c15',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.333439] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.333439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.333439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.333439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.333439] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.333439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.333439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.333439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.333439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.333439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.333439] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.333825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.333825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.333825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.333907] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.333946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.334018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.334510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.334510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.334510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.334510] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7a5ca58-1bdc-49d1-821b-3e40291a7c15',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.423615] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 961.423615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.837798] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7a5ca58-1bdc-49d1-821b-3e40291a7c15: rpc.has_security_group_logging(os_id): False [ 961.857355] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.857355] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.857355] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.857355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.857787] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.857787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.857787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.859129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.859129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.859129] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 is going to be created. [ 961.918283] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.918561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.918561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.918721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.918930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.951175] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 in Status: IN_PROGRESS for 2s [ 962.596380] env[69777]: INFO networking_nsxv3.common.synchronization [req-ad5688fd-b6c8-4461-9421-2d06b4f423b7 req-51a4d024-bf60-4c38-a6b5-536b0cab9215 tempest-ServersV294TestFqdnHostnames-207069780 tempest-ServersV294TestFqdnHostnames-207069780-project-member] Enqueued Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_members [ 962.596952] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGHEST for action security_group_members [ 962.597263] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-af922b11-ba63-48cf-97cd-b04487c3e7f1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.597376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.597437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.597785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.597785] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.597926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.597926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.600713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.600836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.600942] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.668376] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: SUCCESS [ 962.668376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.668376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.668376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.668376] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.668376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.668376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.668376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.668376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.668376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.668376] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.104230] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.104764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.104764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.104764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.104764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.105251] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.105251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.105251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.105251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.105251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.105583] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 is going to be updated. [ 963.123316] env[69777]: INFO networking_nsxv3.common.synchronization [req-c7a3b260-63d8-4395-9219-6eb2346f2c50 req-5c192025-b116-4d9c-a104-6dabb912665b tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_members [ 963.123814] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_members [ 963.124118] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-15fc107d-52a0-4aa7-83cd-a96824b186f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.124237] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.124320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.124577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.126528] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.126528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.126528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.126528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.128016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.128016] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15fc107d-52a0-4aa7-83cd-a96824b186f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.132347] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.132598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.134897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.134897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.134897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.141666] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 in Status: IN_PROGRESS for 2s [ 963.173995] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.173995] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.173995] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.173995] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.173995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.174909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.174909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.174909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.174909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.174909] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.554204] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.554421] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.554551] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.554898] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.555184] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.555355] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.555481] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.555708] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.555860] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.556092] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.556214] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.556330] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.556442] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.556557] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.556669] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.556810] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.575572] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.575800] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 963.575982] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.576231] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.576595] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-0ac3b2b0-8763-4e36-bb16-3d108afd5615 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.576899] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-0ac3b2b0-8763-4e36-bb16-3d108afd5615" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.577067] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-0ac3b2b0-8763-4e36-bb16-3d108afd5615" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.577357] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-0ac3b2b0-8763-4e36-bb16-3d108afd5615" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.577504] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ac3b2b0-8763-4e36-bb16-3d108afd5615',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.629049] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.629049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.629049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.629263] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.629361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.629515] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.629630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.629719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.629873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.629957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.630084] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 already deleted. [ 963.630138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.677940] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ceaf97c-1feb-4a95-a759-71b6308c5c38: rpc.has_security_group_logging(os_id): False [ 963.696053] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.696053] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.696053] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.696053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.696553] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.696553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.696553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.696553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.696661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.696722] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be created. [ 963.755987] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.756179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.756259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.756494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.756710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.780515] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: IN_PROGRESS for 2s [ 963.961757] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 in Status: SUCCESS [ 963.961987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.079855] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.080204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.080371] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.080689] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.080873] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.081074] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 0ac3b2b0-8763-4e36-bb16-3d108afd5615 not found, creating... [ 964.081424] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.081821] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.081821] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.082037] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.082188] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.082541] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.082712] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.082851] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.083125] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.083302] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.083494] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 0ac3b2b0-8763-4e36-bb16-3d108afd5615 is going to be created. [ 964.103650] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.104029] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.104252] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.104704] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.105124] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.105560] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-0ac3b2b0-8763-4e36-bb16-3d108afd5615" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.017687] env[69777]: INFO networking_nsxv3.common.synchronization [req-c7a3b260-63d8-4395-9219-6eb2346f2c50 req-bb4c5e3f-ee2e-44ea-b159-82b822f9f40e service nova] Enqueued Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_rules [ 965.017687] env[69777]: INFO networking_nsxv3.common.synchronization [req-c7a3b260-63d8-4395-9219-6eb2346f2c50 req-bb4c5e3f-ee2e-44ea-b159-82b822f9f40e service nova] Enqueued Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_members [ 965.017687] env[69777]: INFO networking_nsxv3.common.synchronization [req-c7a3b260-63d8-4395-9219-6eb2346f2c50 req-bb4c5e3f-ee2e-44ea-b159-82b822f9f40e service nova] Enqueued Resource ID: 0ac3b2b0-8763-4e36-bb16-3d108afd5615 with Priority: HIGHEST for action port [ 965.017687] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_rules [ 965.017799] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_members [ 965.019706] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac3b2b0-8763-4e36-bb16-3d108afd5615 with Priority: HIGHEST for action port [ 965.019706] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15fc107d-52a0-4aa7-83cd-a96824b186f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.019706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.019706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.019706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.019876] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15fc107d-52a0-4aa7-83cd-a96824b186f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.021062] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-15fc107d-52a0-4aa7-83cd-a96824b186f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.021176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.021243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.021452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.021606] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.021702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.021763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.021917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.022000] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.022206] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15fc107d-52a0-4aa7-83cd-a96824b186f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.022864] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ac3b2b0-8763-4e36-bb16-3d108afd5615 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.022962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ac3b2b0-8763-4e36-bb16-3d108afd5615" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.023041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ac3b2b0-8763-4e36-bb16-3d108afd5615" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.023191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ac3b2b0-8763-4e36-bb16-3d108afd5615" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.024463] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ac3b2b0-8763-4e36-bb16-3d108afd5615',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.151099] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 in Status: SUCCESS [ 965.151391] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 deletion is rescheduled due to dependency. [ 965.151756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.525463] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15fc107d-52a0-4aa7-83cd-a96824b186f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.526862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-15fc107d-52a0-4aa7-83cd-a96824b186f6 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.527146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.527200] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ac3b2b0-8763-4e36-bb16-3d108afd5615 with status ACTIVE [ 965.527329] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.527433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.527489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.527692] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.527773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.527933] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.528032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.528091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.528243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.528315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.528490] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.531021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.531021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.531021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.531021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.531021] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ac3b2b0-8763-4e36-bb16-3d108afd5615 is going to be updated. [ 965.549442] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.549588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.549642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.549881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.550046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.550208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ac3b2b0-8763-4e36-bb16-3d108afd5615" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.794073] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: SUCCESS [ 965.794348] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.032531] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15fc107d-52a0-4aa7-83cd-a96824b186f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.536188] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.536889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.536889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.536889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.536889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.536889] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 is going to be created. [ 966.560679] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.560843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.560932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.561641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.561641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.571453] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 in Status: UNINITIALIZED for 2s [ 967.725672] env[69777]: INFO networking_nsxv3.common.synchronization [req-9df4321c-9c02-4875-94b4-a8a0d534dc0e req-235c951d-a904-4ae1-b2bc-98a6bd4a8814 tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 967.726436] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 967.726755] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.726877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.726945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.729861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.730816] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.730816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.730816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.730816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.730816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.730816] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.121522] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.121733] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.121866] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.122198] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.122462] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.122673] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.122738] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.122951] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.123149] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.123406] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.123541] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.123657] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.123772] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.123887] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.124036] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.124204] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.151518] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.151688] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 968.151837] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.152065] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.152406] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.152585] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.152714] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.153310] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.153463] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.235752] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.235922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.235998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.236227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.236329] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.236627] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.236774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.236905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.237138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.237273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.237444] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 968.267635] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.267635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.267635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.267635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.267635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.275228] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 968.583007] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 in Status: SUCCESS [ 968.583255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.583462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.583681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.583872] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.583990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.584114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.584219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.584302] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.584390] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.584481] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15fc107d-52a0-4aa7-83cd-a96824b186f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.656049] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.656307] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.656444] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.656724] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.656947] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.657101] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4 not found, creating... [ 968.657383] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.657545] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.657667] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.658073] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.658073] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.658319] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.658479] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.658600] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.658839] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.658941] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.659168] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4 is going to be created. [ 968.678142] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.678339] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.678467] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.678712] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.678938] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.679204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.086553] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15fc107d-52a0-4aa7-83cd-a96824b186f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.511346] env[69777]: INFO networking_nsxv3.common.synchronization [req-9df4321c-9c02-4875-94b4-a8a0d534dc0e req-0b5b8889-1e7c-4d9e-8edf-c8cc43d1140c service nova] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_rules [ 969.511346] env[69777]: INFO networking_nsxv3.common.synchronization [req-9df4321c-9c02-4875-94b4-a8a0d534dc0e req-0b5b8889-1e7c-4d9e-8edf-c8cc43d1140c service nova] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 969.511346] env[69777]: INFO networking_nsxv3.common.synchronization [req-9df4321c-9c02-4875-94b4-a8a0d534dc0e req-0b5b8889-1e7c-4d9e-8edf-c8cc43d1140c service nova] Enqueued Resource ID: 019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4 with Priority: HIGHEST for action port [ 969.512109] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_rules [ 969.512861] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 969.512861] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4 with Priority: HIGHEST for action port [ 969.513304] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.513624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.513787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.514117] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.514351] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.515538] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.519409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.520225] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.520477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.520635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.522510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.522510] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.591804] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15fc107d-52a0-4aa7-83cd-a96824b186f6: rpc.has_security_group_logging(os_id): False [ 969.609068] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.609353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.609353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.612638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.612638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.612638] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.612638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.612638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.612638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.612638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.612638] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 is going to be created. [ 969.666270] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.666481] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.666481] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.667099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.667099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.671362] env[69777]: INFO networking_nsxv3.common.synchronization [req-cc78a074-8a6a-48bf-b1fb-4515161b0169 req-7ca2cb6b-4492-401c-8509-ef05797c4341 tempest-VolumesAdminNegativeTest-1280332786 tempest-VolumesAdminNegativeTest-1280332786-project-member] Enqueued Resource ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 with Priority: HIGHEST for action security_group_members [ 969.671933] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 with Priority: HIGHEST for action security_group_members [ 969.672269] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.672392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.672566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.672658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.672812] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.672909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.672973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.673142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.673227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.673356] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7a5ca58-1bdc-49d1-821b-3e40291a7c15',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.680317] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 in Status: IN_PROGRESS for 2s [ 970.022922] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.023145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.023325] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4 with status ACTIVE [ 970.023502] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.023611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.023680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.023899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.023979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.024161] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.024253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.024304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.024443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.024566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.024698] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.024789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.024842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.024973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.025062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.025137] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4 is going to be updated. [ 970.045850] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.046050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.046141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.046399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.046645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.046884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-019e000f-48e0-4cb5-9f3c-4d31dd7ec9c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.175552] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.175880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.175880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.175981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.176548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.176548] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.176548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.176548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.176738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.176738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.176738] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 is going to be updated. [ 970.214426] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.214604] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.214663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.214847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.215153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.223526] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 in Status: IN_PROGRESS for 2s [ 970.285870] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 970.285870] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 deletion is rescheduled due to dependency. [ 970.285870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.285870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.285870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.285870] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.286319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.286319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.286319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.286404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.286521] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.321621] env[69777]: INFO networking_nsxv3.common.synchronization [req-e28d652b-5bf6-4485-85ac-aaaf759f0d86 req-ddf5e84b-3512-4535-b2c5-87d76d0fcc9e tempest-ImagesTestJSON-42450789 tempest-ImagesTestJSON-42450789-project-member] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 970.322155] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 970.322480] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.322601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.322668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.322861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.323016] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.323111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.323174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.323315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.323396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.323485] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.741636] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.742669] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.742669] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.742669] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.743929] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.743929] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.743929] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.743929] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.743929] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.743929] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.744313] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.744313] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.744313] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.744449] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.744449] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.744656] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.768410] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.768601] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 970.768744] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.768922] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.769306] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-5dd3ff95-623e-4f1d-9e74-bd604e8d47e7 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.769510] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-5dd3ff95-623e-4f1d-9e74-bd604e8d47e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.769760] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-5dd3ff95-623e-4f1d-9e74-bd604e8d47e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.770035] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-5dd3ff95-623e-4f1d-9e74-bd604e8d47e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.770218] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dd3ff95-623e-4f1d-9e74-bd604e8d47e7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.789189] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.825317] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.275039] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.275039] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.275039] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.275039] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.275039] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.275039] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 5dd3ff95-623e-4f1d-9e74-bd604e8d47e7 not found, creating... [ 971.275576] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.275576] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.275846] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.276341] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.276341] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.276626] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.276987] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.277259] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.277574] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.277769] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.277883] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 5dd3ff95-623e-4f1d-9e74-bd604e8d47e7 is going to be created. [ 971.291829] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.300823] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.301070] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.301196] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.301560] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.301828] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.302076] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-5dd3ff95-623e-4f1d-9e74-bd604e8d47e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.327999] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.696029] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 in Status: SUCCESS [ 971.696029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.794188] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.794668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.794668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.794668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.794835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.795116] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 971.824577] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.824763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.824860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.825045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.825213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.837165] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 971.837639] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.837812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.837911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.838134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.838226] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.838452] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 971.867192] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.867355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.867429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.867733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.867733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.875138] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 971.939257] env[69777]: INFO networking_nsxv3.common.synchronization [req-a949c5e0-afad-4107-bb81-5bc250d62f39 req-dcd13517-fbdb-4f47-95da-4f0e69edaa7a tempest-MigrationsAdminTest-640993244 tempest-MigrationsAdminTest-640993244-project-member] Enqueued Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 971.939257] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 971.939257] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.939257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.939418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.939845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.939845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.939845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.939845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.940066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.940066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.940239] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.088255] env[69777]: INFO networking_nsxv3.common.synchronization [req-e28d652b-5bf6-4485-85ac-aaaf759f0d86 req-e81f8a78-2d25-46f2-aee3-00b05e878fc1 service nova] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_rules [ 972.088255] env[69777]: INFO networking_nsxv3.common.synchronization [req-e28d652b-5bf6-4485-85ac-aaaf759f0d86 req-e81f8a78-2d25-46f2-aee3-00b05e878fc1 service nova] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 972.088255] env[69777]: INFO networking_nsxv3.common.synchronization [req-e28d652b-5bf6-4485-85ac-aaaf759f0d86 req-e81f8a78-2d25-46f2-aee3-00b05e878fc1 service nova] Enqueued Resource ID: 5dd3ff95-623e-4f1d-9e74-bd604e8d47e7 with Priority: HIGHEST for action port [ 972.088255] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_rules [ 972.088255] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 972.088255] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd3ff95-623e-4f1d-9e74-bd604e8d47e7 with Priority: HIGHEST for action port [ 972.089339] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.089339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.089339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.089657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.089793] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.094486] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.094486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.094827] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dd3ff95-623e-4f1d-9e74-bd604e8d47e7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.094827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dd3ff95-623e-4f1d-9e74-bd604e8d47e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.094978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dd3ff95-623e-4f1d-9e74-bd604e8d47e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.095263] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dd3ff95-623e-4f1d-9e74-bd604e8d47e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.095343] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dd3ff95-623e-4f1d-9e74-bd604e8d47e7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.232872] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 in Status: SUCCESS [ 972.233135] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 deletion is rescheduled due to dependency. [ 972.233255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.443022] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.600274] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dd3ff95-623e-4f1d-9e74-bd604e8d47e7 with status ACTIVE [ 972.600274] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.600274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.600274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.600274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.600274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.600274] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.600274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.600274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.600274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.600274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.600274] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.600274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.600274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.601071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.601071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.601071] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dd3ff95-623e-4f1d-9e74-bd604e8d47e7 is going to be updated. [ 972.602089] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.602299] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.623434] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.623434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.623434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.623673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.623673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.624248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dd3ff95-623e-4f1d-9e74-bd604e8d47e7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.946572] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.107165] env[69777]: INFO networking_nsxv3.common.synchronization [req-3a3f5141-6fdb-4fbe-bb8b-a343296052be req-c525c9eb-9911-4ca1-be36-51af93907e76 tempest-AttachVolumeShelveTestJSON-523183173 tempest-AttachVolumeShelveTestJSON-523183173-project-member] Enqueued Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_members [ 973.107408] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_members [ 973.108154] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.108154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.108154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.108345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.108433] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.108537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.108585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.108739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.108814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.108939] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.450537] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.450537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.450537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.450537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.450537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.450537] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e is going to be updated. [ 973.490073] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.490309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.490410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.490799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.490799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.507039] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.507039] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.507039] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.507275] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.507570] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.507754] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.507905] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.508244] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.508432] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.508739] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.508999] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.509196] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.509419] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.509654] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.510894] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.510894] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.512461] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: IN_PROGRESS for 2s [ 973.533535] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.533617] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 973.533752] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.533941] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.534288] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-1cc2966e-f081-466c-987d-8f4ab76952a3 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.534441] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.534582] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.534865] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.535009] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cc2966e-f081-466c-987d-8f4ab76952a3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.611358] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.611608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.611726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.612033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.612173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.612452] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.612595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.612697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.612909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.613034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.613163] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 already deleted. [ 973.613283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.846413] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 973.846576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.846698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.846916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.847120] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.847240] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.847438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.847438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.847531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.847606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.847693] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.884871] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 973.885129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.885299] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.885521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.885708] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.885827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.885891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.886053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.886136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.886230] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.038417] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.038651] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.038781] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.039135] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.039339] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.039513] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 1cc2966e-f081-466c-987d-8f4ab76952a3 not found, creating... [ 974.039790] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.039958] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.040169] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.040473] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.040713] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.041528] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.041528] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.041670] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.041983] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.042437] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.042437] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 1cc2966e-f081-466c-987d-8f4ab76952a3 is going to be created. [ 974.062966] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.063251] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.063409] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.063725] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.063967] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.064220] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.353433] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.353621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.353621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.353841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.354011] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.354120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.354188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.354334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.354423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.354533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.354682] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.354774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.354873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.355109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.355212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.355325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.355404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.355750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.355750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.355909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.355909] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.391894] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.860236] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2102ed9-efb2-4a2c-a170-b1e7872f4215: rpc.has_security_group_logging(os_id): False [ 974.882698] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.882698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.882698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.882956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.882956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.883172] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.883281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.883362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.883521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.883606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.883803] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.883896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.883968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.886836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.886836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.886836] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.886836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.886836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.886836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.886836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.886836] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 974.893916] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.942566] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.942566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.942566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.942566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.942566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.955706] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 974.973351] env[69777]: INFO networking_nsxv3.common.synchronization [req-3a3f5141-6fdb-4fbe-bb8b-a343296052be req-b2b368c4-6f92-4f3d-8990-0e9a74f44098 service nova] Enqueued Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_rules [ 974.973351] env[69777]: INFO networking_nsxv3.common.synchronization [req-3a3f5141-6fdb-4fbe-bb8b-a343296052be req-b2b368c4-6f92-4f3d-8990-0e9a74f44098 service nova] Enqueued Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_members [ 974.973646] env[69777]: INFO networking_nsxv3.common.synchronization [req-3a3f5141-6fdb-4fbe-bb8b-a343296052be req-b2b368c4-6f92-4f3d-8990-0e9a74f44098 service nova] Enqueued Resource ID: 1cc2966e-f081-466c-987d-8f4ab76952a3 with Priority: HIGHEST for action port [ 974.974243] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_rules [ 974.974243] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_members [ 974.974309] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cc2966e-f081-466c-987d-8f4ab76952a3 with Priority: HIGHEST for action port [ 974.974624] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.974751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.974835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.975476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.975476] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.976036] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.976152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.976223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.976406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.976576] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.976640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.976705] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.976918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.976958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.977076] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.977893] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cc2966e-f081-466c-987d-8f4ab76952a3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.978015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.978113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.978239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.978328] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cc2966e-f081-466c-987d-8f4ab76952a3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.400291] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.400291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.400291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.400291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.400291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.400291] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 975.427970] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.428323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.428491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.428818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.433388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.441960] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 975.480437] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.480579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.480806] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.481942] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1cc2966e-f081-466c-987d-8f4ab76952a3 with status ACTIVE [ 975.481942] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.482146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.482146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.482379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.482496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.482684] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.482809] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.482872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.483009] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.483158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.483343] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.483449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.483525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.483642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.483726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.484188] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1cc2966e-f081-466c-987d-8f4ab76952a3 is going to be updated. [ 975.505698] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.505838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.505899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.506134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.506279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.507242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.522482] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: SUCCESS [ 975.522694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.988307] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.060240] env[69777]: INFO networking_nsxv3.common.synchronization [req-79be9f39-bca5-4c6f-ad1b-2792483a2812 req-de333ed6-1026-4dbb-a0f9-020076a4f293 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_members [ 976.060829] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_members [ 976.062379] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf7f4ddc-ed21-4d94-8cea-71e39c933549 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.062571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.062571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.062811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.063025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.063243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.063243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.063448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.063505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.063625] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf7f4ddc-ed21-4d94-8cea-71e39c933549',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.490965] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.491144] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.491205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.491536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.491726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.491874] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 is going to be created. [ 976.513754] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.513933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.513994] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.514206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.514405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.527881] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 in Status: UNINITIALIZED for 2s [ 976.568199] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.568381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.568452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.568672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.568763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.568942] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.569114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.569166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.569279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.569359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.569461] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 already deleted. [ 976.569541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.872211] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.872429] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.872658] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.873176] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.873628] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.874698] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.874838] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.875151] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.875322] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.875542] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.875662] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.877712] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.877712] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.877712] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.877712] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.877712] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.899023] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.899023] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 976.899023] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.899023] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.899023] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-259732a7-eb75-4736-83ab-bdb91a1a5f44 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.899023] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-259732a7-eb75-4736-83ab-bdb91a1a5f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.899023] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-259732a7-eb75-4736-83ab-bdb91a1a5f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.899023] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-259732a7-eb75-4736-83ab-bdb91a1a5f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.899023] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('259732a7-eb75-4736-83ab-bdb91a1a5f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.981747] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 976.982111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.400464] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.400758] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.400823] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.401121] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.401276] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.401429] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 259732a7-eb75-4736-83ab-bdb91a1a5f44 not found, creating... [ 977.401764] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.403149] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.403344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.403638] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.403814] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.404715] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.404891] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.405088] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.405862] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.405862] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.405862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 259732a7-eb75-4736-83ab-bdb91a1a5f44 is going to be created. [ 977.426836] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.426836] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.426836] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.426836] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.426836] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.426836] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-259732a7-eb75-4736-83ab-bdb91a1a5f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.452960] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 977.453258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.453762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.453972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.454214] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.454346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.454414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.455612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.455612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.455612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.455612] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.736531] env[69777]: INFO networking_nsxv3.common.synchronization [req-01b9f682-b199-44b4-b339-0aa804da2960 req-5f9deae7-c6f9-4e0e-8f64-ed27c6742b1c tempest-ServersAdminTestJSON-1100102510 tempest-ServersAdminTestJSON-1100102510-project-member] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 977.737680] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 977.738565] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.739591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.739591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.739591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.739591] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.739591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.739591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.739591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.739591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.740893] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.960188] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.960188] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.960188] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.960188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.960188] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.960846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.960846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.960846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.960846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.960846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.960846] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.244027] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.462987] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c31a3d66-3f9b-4509-bdc2-763f23333743: rpc.has_security_group_logging(os_id): False [ 978.488595] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.488726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.488797] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.489016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.489144] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.489382] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.489485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.489549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.489703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.489780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.489952] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.490058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.490119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.490283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.490360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.490533] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.490624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.490684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.490822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.490899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.490984] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 978.544922] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 in Status: SUCCESS [ 978.544922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.544922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.544922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.544922] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.544922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.544922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.544922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.544922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.544922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.544922] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.570102] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.570102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.570102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.570102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.570102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.583529] env[69777]: INFO networking_nsxv3.common.synchronization [req-9dc0b40b-62bf-4b21-9614-7cda1e4706be req-bd26b6bb-fae8-46f0-ac66-bbfc2f30871b tempest-ServersTestManualDisk-959404340 tempest-ServersTestManualDisk-959404340-project-member] Enqueued Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_members [ 978.584853] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_members [ 978.590200] env[69777]: INFO networking_nsxv3.common.synchronization [req-79be9f39-bca5-4c6f-ad1b-2792483a2812 req-47c3626e-22a0-40d6-83f6-c86f52360ed1 service nova] Enqueued Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_rules [ 978.590438] env[69777]: INFO networking_nsxv3.common.synchronization [req-79be9f39-bca5-4c6f-ad1b-2792483a2812 req-47c3626e-22a0-40d6-83f6-c86f52360ed1 service nova] Enqueued Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_members [ 978.591084] env[69777]: INFO networking_nsxv3.common.synchronization [req-79be9f39-bca5-4c6f-ad1b-2792483a2812 req-47c3626e-22a0-40d6-83f6-c86f52360ed1 service nova] Enqueued Resource ID: 259732a7-eb75-4736-83ab-bdb91a1a5f44 with Priority: HIGHEST for action port [ 978.591536] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 978.591801] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad5575ce-f5cd-4af5-9757-424d93034877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.591924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.591991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.592255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.592413] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.592514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.592578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.592723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.592805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.592900] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.598152] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_rules [ 978.598152] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_members [ 978.598152] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 259732a7-eb75-4736-83ab-bdb91a1a5f44 with Priority: HIGHEST for action port [ 978.598152] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.598152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.598152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.598152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.598152] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf7f4ddc-ed21-4d94-8cea-71e39c933549',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.598152] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf7f4ddc-ed21-4d94-8cea-71e39c933549 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.598152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.598152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.601669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.602884] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.603069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.603168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.603340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.603425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.603519] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf7f4ddc-ed21-4d94-8cea-71e39c933549',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.604408] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-259732a7-eb75-4736-83ab-bdb91a1a5f44 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.604613] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-259732a7-eb75-4736-83ab-bdb91a1a5f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.604613] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-259732a7-eb75-4736-83ab-bdb91a1a5f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.604728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-259732a7-eb75-4736-83ab-bdb91a1a5f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.604799] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('259732a7-eb75-4736-83ab-bdb91a1a5f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.751195] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.049464] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.097393] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.097596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.097655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.097932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.098058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.098259] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.098362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.098565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.098699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.098740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.098832] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad5575ce-f5cd-4af5-9757-424d93034877 already deleted. [ 979.098916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.107164] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf7f4ddc-ed21-4d94-8cea-71e39c933549 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.107269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.111732] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 259732a7-eb75-4736-83ab-bdb91a1a5f44 with status ACTIVE [ 979.112056] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.112225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.112316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.113162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.113162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.113162] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.113162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.113162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.113345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.113372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.114018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.114018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.114018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.114208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.114295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.114388] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 259732a7-eb75-4736-83ab-bdb91a1a5f44 is going to be updated. [ 979.115878] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf7f4ddc-ed21-4d94-8cea-71e39c933549',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.139449] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.139747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.139747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.140034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.140238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.140448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-259732a7-eb75-4736-83ab-bdb91a1a5f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.168283] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.168542] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-756" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.168708] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-756" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.170504] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-756" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.171464] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.171639] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.171775] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.172061] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.172265] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.172510] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.172650] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.172781] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.172901] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.173044] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.173150] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.173332] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.205469] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.205469] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.205469] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.205469] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-756" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.205469] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.205469] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.205469] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.207176] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.207547] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.251974] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.252196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.252271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.253032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.253032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.253032] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 979.289845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.290027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.290088] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.290336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.290509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.306569] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 979.553167] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec67cf45-130c-446e-bc7a-8c1eb32450c7: rpc.has_security_group_logging(os_id): False [ 979.572969] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.573179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.573253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.573515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.573646] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.573913] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.574023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.574241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.574241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.574349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.574395] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 is going to be created. [ 979.618161] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf7f4ddc-ed21-4d94-8cea-71e39c933549',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.636286] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.636492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.636567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.636781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.637101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.653567] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 in Status: IN_PROGRESS for 2s [ 979.714191] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.714191] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.714191] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.714191] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.714191] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.714191] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b not found, creating... [ 979.714191] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.714574] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.714574] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.714784] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.714827] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.715130] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.715325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.715433] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.715676] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.715833] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.715980] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b is going to be created. [ 979.755077] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.755315] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.755455] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.755817] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.756462] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.756462] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.121318] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.121473] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.121550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.121765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.121857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.121952] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 is going to be created. [ 980.146778] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.146778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.146778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.146778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.146973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.159337] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 in Status: UNINITIALIZED for 2s [ 980.609386] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 980.609888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.087398] env[69777]: INFO networking_nsxv3.common.synchronization [req-9dc0b40b-62bf-4b21-9614-7cda1e4706be req-884b5325-33c8-4692-a447-5834829d3e27 service nova] Enqueued Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_rules [ 981.087600] env[69777]: INFO networking_nsxv3.common.synchronization [req-9dc0b40b-62bf-4b21-9614-7cda1e4706be req-884b5325-33c8-4692-a447-5834829d3e27 service nova] Enqueued Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_members [ 981.087744] env[69777]: INFO networking_nsxv3.common.synchronization [req-9dc0b40b-62bf-4b21-9614-7cda1e4706be req-884b5325-33c8-4692-a447-5834829d3e27 service nova] Enqueued Resource ID: cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b with Priority: HIGHEST for action port [ 981.087989] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_rules [ 981.088136] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_members [ 981.088222] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b with Priority: HIGHEST for action port [ 981.089292] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad5575ce-f5cd-4af5-9757-424d93034877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.089416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.089453] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.089686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.089802] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.091736] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad5575ce-f5cd-4af5-9757-424d93034877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.091736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.091736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.091862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.091944] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.092093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.092130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.092264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.092342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.092436] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.093286] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.093429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.093491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.093618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.093722] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.317842] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 981.318536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.599022] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.599022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad5575ce-f5cd-4af5-9757-424d93034877 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.599022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.599022] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b with status ACTIVE [ 981.599022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.599022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.599022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.599022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.599022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.599022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.599022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.599022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.599022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.599022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.599659] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.599659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.599659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.599659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.599659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.599659] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b is going to be updated. [ 981.624890] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.624890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.624890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.624890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.624890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.624890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd3ccf7c-8fba-4ed1-b155-a5f4c6b2834b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.664271] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 in Status: SUCCESS [ 981.664514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.738871] env[69777]: INFO networking_nsxv3.common.synchronization [None req-79f12d48-d977-4874-a63e-f0f7ebabcb38 None None] Enqueued Resource ID: 96519044-ee74-43b4-8c8b-2a14f4853cfc with Priority: HIGHEST for action port [ 981.739459] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96519044-ee74-43b4-8c8b-2a14f4853cfc with Priority: HIGHEST for action port [ 981.739902] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-96519044-ee74-43b4-8c8b-2a14f4853cfc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.739902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96519044-ee74-43b4-8c8b-2a14f4853cfc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.740026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96519044-ee74-43b4-8c8b-2a14f4853cfc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.741066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96519044-ee74-43b4-8c8b-2a14f4853cfc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.741175] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96519044-ee74-43b4-8c8b-2a14f4853cfc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.106590] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.174337] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 in Status: SUCCESS [ 982.174337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.174337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.174337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.174337] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.174337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.174337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.174337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.174337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.174337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.174337] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf7f4ddc-ed21-4d94-8cea-71e39c933549',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.242354] env[69777]: INFO networking_nsxv3.common.synchronization [req-7efea8a2-823c-45ae-b4ed-b26979cfb7b4 req-624ea8d9-4ae7-4284-8426-a52d8f3aabe9 tempest-ImagesOneServerNegativeTestJSON-1912736822 tempest-ImagesOneServerNegativeTestJSON-1912736822-project-member] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 982.242354] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 982.242354] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.243446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.243753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.244135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.244811] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.245079] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.247763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.247763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.247763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.247763] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.248853] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96519044-ee74-43b4-8c8b-2a14f4853cfc [ 982.249307] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.249307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.249307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.249426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.249550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.249607] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96519044-ee74-43b4-8c8b-2a14f4853cfc already deleted. [ 982.249650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96519044-ee74-43b4-8c8b-2a14f4853cfc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.612938] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.614137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.614239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.614480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.614572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.614678] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad5575ce-f5cd-4af5-9757-424d93034877 is going to be created. [ 982.637234] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.637539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.637539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.638132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.638132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.649622] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad5575ce-f5cd-4af5-9757-424d93034877 in Status: UNINITIALIZED for 2s [ 982.680771] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf7f4ddc-ed21-4d94-8cea-71e39c933549',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.751037] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.751228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.751315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.751601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.751717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.754244] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.754244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.754244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.754244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.754244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.754244] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be updated. [ 982.797363] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.797509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.797604] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.797774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.797906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.814154] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: IN_PROGRESS for 2s [ 983.182940] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf7f4ddc-ed21-4d94-8cea-71e39c933549: rpc.has_security_group_logging(os_id): False [ 983.211502] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.211662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.211783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.211935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.212060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.212340] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.212487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.212569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.212769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.212857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.212970] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 is going to be created. [ 983.303036] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.303247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.303349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.303972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.303972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.328029] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 in Status: IN_PROGRESS for 2s [ 983.825185] env[69777]: INFO networking_nsxv3.common.synchronization [req-48ae4f63-7cce-442b-9d27-05b17e47c677 req-9967b0ba-9b1f-43a0-84cb-bc1f82c295ad tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 983.828533] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 983.831250] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.831250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.831250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.831250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.831250] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.831250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.831250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.831250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.831250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.831250] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.865431] env[69777]: INFO networking_nsxv3.common.synchronization [None req-e9d3c703-dcad-4a75-9986-3cbbe37b6013 None None] Enqueued Resource ID: 091db9dd-b219-4319-b8e5-984de0d81067 with Priority: HIGHEST for action port [ 983.866809] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091db9dd-b219-4319-b8e5-984de0d81067 with Priority: HIGHEST for action port [ 983.867301] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-091db9dd-b219-4319-b8e5-984de0d81067 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.867842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-091db9dd-b219-4319-b8e5-984de0d81067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.867842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-091db9dd-b219-4319-b8e5-984de0d81067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.867938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-091db9dd-b219-4319-b8e5-984de0d81067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.868030] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('091db9dd-b219-4319-b8e5-984de0d81067',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.333304] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.333492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.333579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.333808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.333905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.334153] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.336231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.336231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.336231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.336231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.336231] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 984.363046] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.363198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.364166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.364166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.364166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.376312] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 984.376535] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 091db9dd-b219-4319-b8e5-984de0d81067 [ 984.376750] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.376877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.376947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.377234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.377326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.377421] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:091db9dd-b219-4319-b8e5-984de0d81067 already deleted. [ 984.377500] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-091db9dd-b219-4319-b8e5-984de0d81067" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.637189] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.637420] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.637567] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.637856] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.638204] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.641024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.641024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.641024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.641024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.641024] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 984.641024] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.641024] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.641024] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.641024] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 984.641024] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.641024] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.657577] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad5575ce-f5cd-4af5-9757-424d93034877 in Status: SUCCESS [ 984.657973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.658627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.658902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.659156] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.659325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.659392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.659606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.659712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.659862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.659941] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.664777] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.664994] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 984.665700] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.665700] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.666231] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-b4def1eb-3129-45d5-a42f-87832ede16de taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.666432] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-b4def1eb-3129-45d5-a42f-87832ede16de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.666583] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-b4def1eb-3129-45d5-a42f-87832ede16de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.667259] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-b4def1eb-3129-45d5-a42f-87832ede16de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.669077] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4def1eb-3129-45d5-a42f-87832ede16de',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.828588] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: SUCCESS [ 984.829977] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 deletion is rescheduled due to dependency. [ 984.829977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.165998] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.171589] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.171757] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.172382] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.172509] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.172712] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.172965] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port b4def1eb-3129-45d5-a42f-87832ede16de not found, creating... [ 985.173515] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.173762] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.174250] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.174250] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.174739] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.175024] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.175319] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.175408] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.175683] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.175869] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.176067] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: b4def1eb-3129-45d5-a42f-87832ede16de is going to be created. [ 985.202110] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.202110] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.202110] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.202110] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.202382] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.202517] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-b4def1eb-3129-45d5-a42f-87832ede16de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.344640] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 in Status: SUCCESS [ 985.344901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.672043] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad5575ce-f5cd-4af5-9757-424d93034877: rpc.has_security_group_logging(os_id): False [ 985.688256] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.688392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.688458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.688692] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.688781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.689059] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.689184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.689248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.689402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.689475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.689561] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad5575ce-f5cd-4af5-9757-424d93034877 is going to be created. [ 985.804188] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.804331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.804368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.805792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.805792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.821163] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad5575ce-f5cd-4af5-9757-424d93034877 in Status: IN_PROGRESS for 2s [ 986.179932] env[69777]: INFO networking_nsxv3.common.synchronization [req-48ae4f63-7cce-442b-9d27-05b17e47c677 req-ef3ccb30-bca5-4f60-adca-cca0376c0473 service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 986.180417] env[69777]: INFO networking_nsxv3.common.synchronization [req-48ae4f63-7cce-442b-9d27-05b17e47c677 req-ef3ccb30-bca5-4f60-adca-cca0376c0473 service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 986.180417] env[69777]: INFO networking_nsxv3.common.synchronization [req-48ae4f63-7cce-442b-9d27-05b17e47c677 req-ef3ccb30-bca5-4f60-adca-cca0376c0473 service nova] Enqueued Resource ID: b4def1eb-3129-45d5-a42f-87832ede16de with Priority: HIGHEST for action port [ 986.180842] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 986.180970] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 986.181416] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4def1eb-3129-45d5-a42f-87832ede16de with Priority: HIGHEST for action port [ 986.181723] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.181844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.181903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.182115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.182238] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.183022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.183121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.183324] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4def1eb-3129-45d5-a42f-87832ede16de taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.183427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4def1eb-3129-45d5-a42f-87832ede16de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.183491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4def1eb-3129-45d5-a42f-87832ede16de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.183653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4def1eb-3129-45d5-a42f-87832ede16de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.183730] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4def1eb-3129-45d5-a42f-87832ede16de',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.386022] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 986.386022] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 986.386022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.386174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.386354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.386551] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.386695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.386738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.387804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.387804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.387804] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.685520] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.685520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.690022] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4def1eb-3129-45d5-a42f-87832ede16de with status ACTIVE [ 986.690022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.690022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.690022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.690022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.690022] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4def1eb-3129-45d5-a42f-87832ede16de is going to be updated. [ 986.714474] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.714474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.714474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.714474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.714474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.714474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4def1eb-3129-45d5-a42f-87832ede16de" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.891899] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.397855] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.834937] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad5575ce-f5cd-4af5-9757-424d93034877 in Status: SUCCESS [ 987.835174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.909186] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.909186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.909349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.909803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.909803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.909803] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 987.944984] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.945200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.945258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.945480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.945683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.954322] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 989.965570] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 989.965831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.966531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.966734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.966965] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.967515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.967515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.967515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.967515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.967515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.967689] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.479925] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.479925] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.479925] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.479925] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.479925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.480657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.480657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.480657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.480657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.480657] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.989754] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44fd483-f70f-4a69-967b-e48536b42565: rpc.has_security_group_logging(os_id): False [ 991.008213] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.008213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.008213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.008213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.008213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.008392] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.008482] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.008543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.008690] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.008765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.008964] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.009063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.009126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.009344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.009450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.009687] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.009807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.009889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.012235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.012445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.012506] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 991.068228] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.068426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.068502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.068736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.068890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.083653] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 991.182238] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 991.182392] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 992.105191] env[69777]: INFO networking_nsxv3.common.synchronization [req-c67e5a4e-14d3-44c0-a937-b1d053c06a33 req-ac684bd9-c11a-4f71-885b-3dae8b20db47 tempest-ImagesTestJSON-42450789 tempest-ImagesTestJSON-42450789-project-member] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 992.105809] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 992.106174] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.106307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.106391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.106616] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.107033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.107033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.107033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.107599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.107599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.107599] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.611215] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.099082] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 993.099377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.114427] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.617680] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.617767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.617803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.618020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.618114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.618217] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 993.647862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.648014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.648091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.648293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.648439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.655956] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 995.667696] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 995.668083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.107428] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 997.107794] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 997.114652] env[69777]: INFO networking_nsxv3.common.synchronization [req-a35bd805-2778-4384-8b91-6254a2fe692a req-c6ba1a4b-20d7-4640-9214-192b01c31202 tempest-ServersWithSpecificFlavorTestJSON-1722080042 tempest-ServersWithSpecificFlavorTestJSON-1722080042-project-member] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 997.115305] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGHEST for action security_group_members [ 997.115696] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.115860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.115954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.116957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.117578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.117745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.118446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.118838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.118958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.119113] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.624007] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.624007] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.624007] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.624007] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.624007] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.624007] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.624007] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.624007] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.624007] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.624007] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.624007] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 is going to be updated. [ 997.653017] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.653017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.653017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.653017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.653017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.661732] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: IN_PROGRESS for 2s [ 997.914572] env[69777]: INFO networking_nsxv3.common.synchronization [None req-6bf7c956-9981-44ec-8519-9c3b3de01633 None None] Enqueued Resource ID: 7557035c-dc2f-4ff3-9af5-f9da93a98933 with Priority: HIGHEST for action port [ 997.915330] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7557035c-dc2f-4ff3-9af5-f9da93a98933 with Priority: HIGHEST for action port [ 997.915794] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-7557035c-dc2f-4ff3-9af5-f9da93a98933 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.916061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7557035c-dc2f-4ff3-9af5-f9da93a98933" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.916113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7557035c-dc2f-4ff3-9af5-f9da93a98933" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.916417] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7557035c-dc2f-4ff3-9af5-f9da93a98933" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.916484] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7557035c-dc2f-4ff3-9af5-f9da93a98933',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.418804] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7557035c-dc2f-4ff3-9af5-f9da93a98933 [ 998.419087] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.419183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.419271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.419496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.419585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.419680] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7557035c-dc2f-4ff3-9af5-f9da93a98933 already deleted. [ 998.419761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7557035c-dc2f-4ff3-9af5-f9da93a98933" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.671658] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 in Status: SUCCESS [ 999.671954] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 deletion is rescheduled due to dependency. [ 999.671999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.317445] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a4e93f4b-cc34-4c76-bea5-73eb2781ad7d None None] Enqueued Resource ID: f571ca9c-a8e9-4a47-8d03-d838bb6706ab with Priority: HIGHEST for action port [ 1000.317722] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f571ca9c-a8e9-4a47-8d03-d838bb6706ab with Priority: HIGHEST for action port [ 1000.319685] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f571ca9c-a8e9-4a47-8d03-d838bb6706ab taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.319685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f571ca9c-a8e9-4a47-8d03-d838bb6706ab" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.319685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f571ca9c-a8e9-4a47-8d03-d838bb6706ab" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.319685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f571ca9c-a8e9-4a47-8d03-d838bb6706ab" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.319685] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f571ca9c-a8e9-4a47-8d03-d838bb6706ab',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.823953] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f571ca9c-a8e9-4a47-8d03-d838bb6706ab [ 1000.824357] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.824357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.824479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.824632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.824693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.824902] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f571ca9c-a8e9-4a47-8d03-d838bb6706ab already deleted. [ 1000.824902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f571ca9c-a8e9-4a47-8d03-d838bb6706ab" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.740089] env[69777]: INFO networking_nsxv3.common.synchronization [req-40a2b033-60ac-4592-a1cd-5328b6e24d1e req-569d1d35-1099-4304-9d57-bcefcc409bfa tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 1001.740588] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 1001.741765] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.741765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.741765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.741765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.741765] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.741765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.741765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.741765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.742110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.742110] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.759378] env[69777]: INFO networking_nsxv3.common.synchronization [req-40a2b033-60ac-4592-a1cd-5328b6e24d1e req-569d1d35-1099-4304-9d57-bcefcc409bfa tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_rules [ 1001.759581] env[69777]: INFO networking_nsxv3.common.synchronization [req-40a2b033-60ac-4592-a1cd-5328b6e24d1e req-569d1d35-1099-4304-9d57-bcefcc409bfa tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 1001.759773] env[69777]: INFO networking_nsxv3.common.synchronization [req-40a2b033-60ac-4592-a1cd-5328b6e24d1e req-569d1d35-1099-4304-9d57-bcefcc409bfa tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b2657c1a-07a4-4c68-86f5-4fceb0e835b9 with Priority: HIGHEST for action port [ 1001.760228] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_rules [ 1001.760410] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 1001.760535] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2657c1a-07a4-4c68-86f5-4fceb0e835b9 with Priority: HIGHEST for action port [ 1001.760834] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.760959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.761051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.761243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.761322] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.762574] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.762675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.762868] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.762966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.763043] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.763202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.763279] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2657c1a-07a4-4c68-86f5-4fceb0e835b9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.244439] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.265448] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.265448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.265448] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2657c1a-07a4-4c68-86f5-4fceb0e835b9 with status ACTIVE [ 1002.265448] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.265448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.265839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.265839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.265839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.265999] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.266148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.266196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.266349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.266448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.266635] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.266727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.266784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.266926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.266998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.267098] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2657c1a-07a4-4c68-86f5-4fceb0e835b9 is going to be updated. [ 1002.297591] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.297591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.297793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.299201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.299201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.299201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.746652] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.250211] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.250541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.250541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.250742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.250827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.250989] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 is going to be updated. [ 1003.294975] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.295132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.295174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.295438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.295615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.307079] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: IN_PROGRESS for 2s [ 1003.642930] env[69777]: INFO networking_nsxv3.common.synchronization [req-2ebb6600-31a2-4c82-b305-b4553a89c078 req-d125a078-012a-40e1-b31b-bb177b30a7c5 tempest-MigrationsAdminTest-640993244 tempest-MigrationsAdminTest-640993244-project-member] Enqueued Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 1003.643457] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGHEST for action security_group_members [ 1003.643750] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.643872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.643940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.644150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.644305] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.644408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.644472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.644619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.644701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.644835] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.899020] env[69777]: INFO networking_nsxv3.common.synchronization [req-b84c642b-8053-43d9-a511-dd9e1bd482ff req-f75d650c-2ede-4953-bf1f-5272f069904c tempest-ServerActionsV293TestJSON-1792954736 tempest-ServerActionsV293TestJSON-1792954736-project-member] Enqueued Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_members [ 1003.899020] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGHEST for action security_group_members [ 1003.899020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4058bf2e-e500-4002-898a-0d2b9aa510e5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.899020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.899020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.899020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.899488] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.899731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.899912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.900200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.901835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.901835] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.146857] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.147039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.147118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.147419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.147511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.147648] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.147802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.147802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.147943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.148026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.148111] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e is going to be updated. [ 1004.189154] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.189331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.189405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.189636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.189783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.203570] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: IN_PROGRESS for 2s [ 1004.406025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.406025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.406025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.406025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.406025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.406025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.406025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.406025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.406025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.406025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.406025] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 is going to be updated. [ 1004.509562] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.509562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.509562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.509562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.509562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.519881] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 in Status: IN_PROGRESS for 2s [ 1005.187356] env[69777]: INFO networking_nsxv3.common.synchronization [req-a996ead4-c2d1-4912-bb8c-b3079b4a2ca1 req-2f4d86e9-46fc-4792-9865-d22f8974c49d tempest-ServersAdminTestJSON-1100102510 tempest-ServersAdminTestJSON-1100102510-project-member] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 1005.188071] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGHEST for action security_group_members [ 1005.188464] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.188464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.188643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.188822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.188967] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.189078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.189306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.189804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.190949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.190949] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.324069] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: SUCCESS [ 1005.324069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.324069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.324069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.324069] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.324069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.324069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.324069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.324069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.324069] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.438597] env[69777]: INFO networking_nsxv3.common.synchronization [req-256f1308-a455-4c0e-9f52-2404b7164c4a req-27634e71-e8a4-4462-8230-79d7204ac722 tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 1005.439912] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 1005.440206] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.440339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.471747] env[69777]: INFO networking_nsxv3.common.synchronization [req-256f1308-a455-4c0e-9f52-2404b7164c4a req-27634e71-e8a4-4462-8230-79d7204ac722 tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_rules [ 1005.471747] env[69777]: INFO networking_nsxv3.common.synchronization [req-256f1308-a455-4c0e-9f52-2404b7164c4a req-27634e71-e8a4-4462-8230-79d7204ac722 tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 1005.471747] env[69777]: INFO networking_nsxv3.common.synchronization [req-256f1308-a455-4c0e-9f52-2404b7164c4a req-27634e71-e8a4-4462-8230-79d7204ac722 tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b2657c1a-07a4-4c68-86f5-4fceb0e835b9 with Priority: HIGHEST for action port [ 1005.471747] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_rules [ 1005.471747] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 1005.471747] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2657c1a-07a4-4c68-86f5-4fceb0e835b9 with Priority: HIGHEST for action port [ 1005.472373] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.472373] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.472715] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.473455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.473455] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.473455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.473455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.473636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.473636] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2657c1a-07a4-4c68-86f5-4fceb0e835b9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.693863] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.694072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.694153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.694364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.716563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.716563] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.716563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.716563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.716783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.716783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.716783] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be updated. [ 1005.750314] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.750314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.750314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.750314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.750314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.761759] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: IN_PROGRESS for 2s [ 1005.826433] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.977545] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2657c1a-07a4-4c68-86f5-4fceb0e835b9 with status ACTIVE [ 1005.977545] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.977545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.977545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.980017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.980017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.980017] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.980017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.980017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.980017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.980017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.980017] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.980017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.980017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.980017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.980017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.980017] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2657c1a-07a4-4c68-86f5-4fceb0e835b9 is going to be updated. [ 1006.001769] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.001930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.001989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.002208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.002834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.002907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2657c1a-07a4-4c68-86f5-4fceb0e835b9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.215685] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e in Status: SUCCESS [ 1006.215900] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e deletion is rescheduled due to dependency. [ 1006.215987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.328846] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.527126] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 in Status: SUCCESS [ 1006.527818] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 deletion is rescheduled due to dependency. [ 1006.527986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.831322] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.831682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.831682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.831856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.831856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.831954] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 is going to be updated. [ 1006.861357] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.861357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.861357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.861357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.861357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.868087] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: IN_PROGRESS for 2s [ 1006.913235] env[69777]: INFO networking_nsxv3.common.synchronization [req-2bc4b510-3358-416b-974f-1f7250b61e3b req-bda4d62a-2d84-4523-8964-214bf5217263 tempest-VolumesAdminNegativeTest-1280332786 tempest-VolumesAdminNegativeTest-1280332786-project-member] Enqueued Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_members [ 1006.913847] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGHEST for action security_group_members [ 1006.914255] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-df000c73-dfce-4f6a-a3af-75deec8fae28 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.914364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.914415] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.914628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.914786] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.914888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.914951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.919265] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.919371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.922813] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.428521] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.428521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.428655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.428830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.429409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.431416] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.431641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.431740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.431962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.432073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.432174] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df000c73-dfce-4f6a-a3af-75deec8fae28 is going to be updated. [ 1007.460613] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.460828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.460828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.461025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.461204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.469502] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df000c73-dfce-4f6a-a3af-75deec8fae28 in Status: IN_PROGRESS for 2s [ 1007.785988] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e in Status: SUCCESS [ 1007.786267] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e deletion is rescheduled due to dependency. [ 1007.786308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.878840] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: SUCCESS [ 1008.879110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.879110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.879380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.879639] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.879814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.879906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.880210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.880210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.880638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.880638] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.881355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.881538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.881953] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.881953] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.881953] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.882121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.882121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.882214] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.386573] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.388604] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.480014] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df000c73-dfce-4f6a-a3af-75deec8fae28 in Status: SUCCESS [ 1009.480014] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df000c73-dfce-4f6a-a3af-75deec8fae28 deletion is rescheduled due to dependency. [ 1009.480191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.603202] env[69777]: INFO networking_nsxv3.common.synchronization [req-853be7d0-cf34-4162-999e-81738aa4cd96 req-5a90a174-00f4-4588-b392-ff740bc073ff tempest-AttachInterfacesUnderV243Test-1816637748 tempest-AttachInterfacesUnderV243Test-1816637748-project-member] Enqueued Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 1009.603904] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b996564e-da05-46dc-ae53-630950b9f5c4 with Priority: HIGHEST for action security_group_members [ 1009.608636] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-b996564e-da05-46dc-ae53-630950b9f5c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.608636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.888967] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b996564e-da05-46dc-ae53-630950b9f5c4: rpc.has_security_group_logging(os_id): False [ 1009.890332] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.906851] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.907246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.907246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.907374] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.907447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.907726] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.908029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.908103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.908262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.908433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.908544] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 is going to be updated. [ 1009.968194] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.968194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.968194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.968194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.968194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.983664] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: IN_PROGRESS for 2s [ 1010.343427] env[69777]: INFO networking_nsxv3.common.synchronization [req-26a71f3a-12e4-43b9-9aff-3f0b10d345af req-26d87f44-7330-4839-8da3-127c992df9d7 tempest-ServerPasswordTestJSON-1895927954 tempest-ServerPasswordTestJSON-1895927954-project-member] Enqueued Resource ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 with Priority: HIGHEST for action security_group_members [ 1010.343999] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 with Priority: HIGHEST for action security_group_members [ 1010.344564] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-96e24b09-4a12-4902-8139-2df8e6a535e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.344564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.344564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.344779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.344913] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.345498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.345708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.345798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.345853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.345952] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96e24b09-4a12-4902-8139-2df8e6a535e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.392885] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.393050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.393129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.393340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.393479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.393584] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 is going to be updated. [ 1010.421545] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.421698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.421740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.421955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.422113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.430302] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: IN_PROGRESS for 2s [ 1010.685347] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.686018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-328" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.686018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-328" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.686018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-328" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.686528] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.686703] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.686831] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.687115] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.687297] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.688045] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.688045] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.688045] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.688045] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.688045] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.688276] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.688276] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.709602] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.709794] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1010.709946] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.710151] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-328" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.710507] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-5723251f-b73e-41f7-a29b-bf40c602ba88 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.710808] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-5723251f-b73e-41f7-a29b-bf40c602ba88" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.710808] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-5723251f-b73e-41f7-a29b-bf40c602ba88" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.712988] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-5723251f-b73e-41f7-a29b-bf40c602ba88" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.712988] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5723251f-b73e-41f7-a29b-bf40c602ba88',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.848688] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.848863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.848929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.849658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.849658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.849658] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.849658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.849658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.850058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.850058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.850058] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 already deleted. [ 1010.850058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.215300] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.215724] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.215724] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.215918] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.216084] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.216249] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 5723251f-b73e-41f7-a29b-bf40c602ba88 not found, creating... [ 1011.216509] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.216810] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.216810] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.217021] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.217166] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.217463] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.217624] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.217747] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.217957] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.218107] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.218250] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 5723251f-b73e-41f7-a29b-bf40c602ba88 is going to be created. [ 1011.243177] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.243440] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.243520] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.243792] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.244043] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.244283] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-5723251f-b73e-41f7-a29b-bf40c602ba88" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.592290] env[69777]: INFO networking_nsxv3.common.synchronization [req-a4e33a46-eb78-4831-9887-8bfaa15bdb60 req-c38dc232-23ef-4f19-8ed5-83df4e65ba94 tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1011.593216] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1011.593216] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.593383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.593383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.593648] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.593841] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.593977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.594211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.594402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.594516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.594621] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.997145] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: SUCCESS [ 1011.997601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.997891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.998144] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.998273] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.057000] env[69777]: INFO networking_nsxv3.common.synchronization [req-26a71f3a-12e4-43b9-9aff-3f0b10d345af req-13fd22ac-e289-4392-8c97-b47f7cef720f service nova] Enqueued Resource ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 with Priority: HIGHEST for action security_group_rules [ 1012.057210] env[69777]: INFO networking_nsxv3.common.synchronization [req-26a71f3a-12e4-43b9-9aff-3f0b10d345af req-13fd22ac-e289-4392-8c97-b47f7cef720f service nova] Enqueued Resource ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 with Priority: HIGHEST for action security_group_members [ 1012.057380] env[69777]: INFO networking_nsxv3.common.synchronization [req-26a71f3a-12e4-43b9-9aff-3f0b10d345af req-13fd22ac-e289-4392-8c97-b47f7cef720f service nova] Enqueued Resource ID: 5723251f-b73e-41f7-a29b-bf40c602ba88 with Priority: HIGHEST for action port [ 1012.057664] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 with Priority: HIGHEST for action security_group_rules [ 1012.057738] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 with Priority: HIGHEST for action security_group_members [ 1012.057835] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5723251f-b73e-41f7-a29b-bf40c602ba88 with Priority: HIGHEST for action port [ 1012.062020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96e24b09-4a12-4902-8139-2df8e6a535e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.062020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.062020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.062020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.062020] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96e24b09-4a12-4902-8139-2df8e6a535e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.062020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-96e24b09-4a12-4902-8139-2df8e6a535e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.062020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.062020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.062020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.062020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.062020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.062020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.062769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.062769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.062769] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96e24b09-4a12-4902-8139-2df8e6a535e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.063212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-5723251f-b73e-41f7-a29b-bf40c602ba88 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.063277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5723251f-b73e-41f7-a29b-bf40c602ba88" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.063328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5723251f-b73e-41f7-a29b-bf40c602ba88" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.063516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5723251f-b73e-41f7-a29b-bf40c602ba88" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.064687] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5723251f-b73e-41f7-a29b-bf40c602ba88',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.097154] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.097309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.097385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.097667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.097775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.098378] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.098378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.098378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.098378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.098621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.098621] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1012.126993] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.126993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.126993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.126993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.126993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.138961] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1012.439072] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b996564e-da05-46dc-ae53-630950b9f5c4 in Status: SUCCESS [ 1012.439378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.439492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.439698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.440013] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.440013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.440200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.440246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.440297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.440396] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.517205] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.517429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.517539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.517857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.517995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.518187] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 is going to be deleted. [ 1012.566465] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.566630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.566722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.566946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.567128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.567193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.567422] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5723251f-b73e-41f7-a29b-bf40c602ba88 with status ACTIVE [ 1012.567618] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.567735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.567801] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.568039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.568072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.568277] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.568322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.568385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.568527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.568956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.569231] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.569356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.569452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.569618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.569696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.569810] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5723251f-b73e-41f7-a29b-bf40c602ba88 is going to be updated. [ 1012.571405] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-96e24b09-4a12-4902-8139-2df8e6a535e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.571522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.571678] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96e24b09-4a12-4902-8139-2df8e6a535e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.591539] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.591711] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.591792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.592050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.592206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.592393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5723251f-b73e-41f7-a29b-bf40c602ba88" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.942962] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.943173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.943249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.943503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.943622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.943851] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.943953] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.944045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.944218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.944402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.944402] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 is going to be deleted. [ 1012.959890] env[69777]: INFO networking_nsxv3.common.synchronization [req-2b2e8ca8-33d9-40a7-956e-f40049ccbd8d req-e751e6bf-d982-4589-889d-da7ff5a69c82 tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1012.960454] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1012.960856] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.961203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.961305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.961540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.961723] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.961864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.961930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.962096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.962208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.962352] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.972692] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.972853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.972938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.973228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.973401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.973449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.974274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.974274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.974274] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.974379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.974446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.975062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.975192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.975323] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b996564e-da05-46dc-ae53-630950b9f5c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.074296] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96e24b09-4a12-4902-8139-2df8e6a535e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.436059] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.436478] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.436709] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.437120] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.441018] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.441018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.441018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.441018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.441018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.441018] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.441018] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.441018] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.441018] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.441018] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.441018] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.441018] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.461947] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.461947] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.461947] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.461947] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.462255] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-91ad1939-84c4-423d-bf33-657ed93ceded taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.462484] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-91ad1939-84c4-423d-bf33-657ed93ceded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.462639] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-91ad1939-84c4-423d-bf33-657ed93ceded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.463040] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-91ad1939-84c4-423d-bf33-657ed93ceded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.463121] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ad1939-84c4-423d-bf33-657ed93ceded',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.464345] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.478232] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.478232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.478232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.478982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.478982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.478982] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.478982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.478982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.479255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.479255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.479255] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b996564e-da05-46dc-ae53-630950b9f5c4 already deleted. [ 1013.479361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b996564e-da05-46dc-ae53-630950b9f5c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.579509] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.579673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.579748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.579979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.580109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.580213] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 is going to be created. [ 1013.603154] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.603328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.603372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.604372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.604562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.612696] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 in Status: UNINITIALIZED for 2s [ 1013.966994] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.967624] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.967624] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.967852] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.967852] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.967972] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 91ad1939-84c4-423d-bf33-657ed93ceded not found, creating... [ 1013.968235] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.968393] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.968515] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.968737] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.968878] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.969206] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.969421] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.969557] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.969799] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.969964] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.970136] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 91ad1939-84c4-423d-bf33-657ed93ceded is going to be created. [ 1013.971536] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.994276] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.994529] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.994660] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.994932] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.995179] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.995407] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-91ad1939-84c4-423d-bf33-657ed93ceded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.148535] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1014.148670] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 1014.148846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.475103] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.475103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.475103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.475536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.475536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.475536] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1014.517989] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.518170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.518227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.518432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.518581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.527701] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1014.701297] env[69777]: INFO networking_nsxv3.common.synchronization [req-2b2e8ca8-33d9-40a7-956e-f40049ccbd8d req-7001896c-4866-490b-a88a-12427f69e51b service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 1014.701297] env[69777]: INFO networking_nsxv3.common.synchronization [req-2b2e8ca8-33d9-40a7-956e-f40049ccbd8d req-7001896c-4866-490b-a88a-12427f69e51b service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1014.701297] env[69777]: INFO networking_nsxv3.common.synchronization [req-2b2e8ca8-33d9-40a7-956e-f40049ccbd8d req-7001896c-4866-490b-a88a-12427f69e51b service nova] Enqueued Resource ID: 91ad1939-84c4-423d-bf33-657ed93ceded with Priority: HIGHEST for action port [ 1014.701624] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 1014.701807] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1014.701917] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91ad1939-84c4-423d-bf33-657ed93ceded with Priority: HIGHEST for action port [ 1014.702248] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.702376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.702965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.702965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.702965] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.703561] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.703643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.704047] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-91ad1939-84c4-423d-bf33-657ed93ceded taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.704047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91ad1939-84c4-423d-bf33-657ed93ceded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.704047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91ad1939-84c4-423d-bf33-657ed93ceded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.704191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91ad1939-84c4-423d-bf33-657ed93ceded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.704191] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ad1939-84c4-423d-bf33-657ed93ceded',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.206354] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.206354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.207629] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91ad1939-84c4-423d-bf33-657ed93ceded with status ACTIVE [ 1015.207821] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.207943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.208019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.208241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.208330] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.208502] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.208612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.208675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.208831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.208923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.209128] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.209225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.209287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.209504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.209583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.209684] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91ad1939-84c4-423d-bf33-657ed93ceded is going to be updated. [ 1015.231131] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.231304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.231347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.231578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.231724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.231880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91ad1939-84c4-423d-bf33-657ed93ceded" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.617017] env[69777]: INFO networking_nsxv3.common.synchronization [req-2986d563-2516-4ead-9d75-b9edc265bd32 req-12a63dcd-3de4-406c-b750-9aa38edbda1e tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1015.617715] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1015.618034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.618160] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.618227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.618468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.618622] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.618720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.618785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.618935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.619030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.619121] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.623019] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 in Status: SUCCESS [ 1015.623019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.623019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.623019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.623019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.623019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.623019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.623339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.623339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.623339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.623339] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96e24b09-4a12-4902-8139-2df8e6a535e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.036719] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.037017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.037178] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.037488] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.037798] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.037965] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.038112] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.038345] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.038509] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.038743] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.038866] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.038985] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.039121] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.039284] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.039383] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.039544] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.057488] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.057693] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1016.057821] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.057995] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.058330] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-435d3887-536a-4895-954c-5c225161069d taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.058541] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-435d3887-536a-4895-954c-5c225161069d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.058676] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-435d3887-536a-4895-954c-5c225161069d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.058992] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-435d3887-536a-4895-954c-5c225161069d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.059174] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('435d3887-536a-4895-954c-5c225161069d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.121487] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.121642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.121715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.122370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.122370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.122370] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.122370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.122370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.122633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.122715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.122802] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 already deleted. [ 1016.122883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.125274] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-96e24b09-4a12-4902-8139-2df8e6a535e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.125399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.125454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.125579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.125773] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.125840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.125872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.125991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.126090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.126171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.126333] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-96e24b09-4a12-4902-8139-2df8e6a535e0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.126392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.126485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.126590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.127304] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.127421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.127421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.127573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.127650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.127733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.127824] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96e24b09-4a12-4902-8139-2df8e6a535e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.536779] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1016.537015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.537191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.537408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.537594] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.537714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.537781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.537928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.538016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.538128] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.561775] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.561996] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.562146] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.562440] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.562597] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.562764] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 435d3887-536a-4895-954c-5c225161069d not found, creating... [ 1016.563043] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.563213] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.563370] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.563557] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.563702] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.563988] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.564163] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.564286] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.564495] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.564635] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.564777] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 435d3887-536a-4895-954c-5c225161069d is going to be created. [ 1016.583452] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.583680] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.583808] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.584095] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.584344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.584581] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-435d3887-536a-4895-954c-5c225161069d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.630055] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96e24b09-4a12-4902-8139-2df8e6a535e0: rpc.has_security_group_logging(os_id): False [ 1016.648496] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.648680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.648773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.649082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.649183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.649430] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.649557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.649612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.649804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.649908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.650145] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.650274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.650353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.650540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.650639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.650876] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.651015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.651109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.651287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.651388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.651499] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 is going to be created. [ 1016.730551] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.730719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.730759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.730962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.731226] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.743429] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 in Status: IN_PROGRESS for 2s [ 1017.041054] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.528463] env[69777]: INFO networking_nsxv3.common.synchronization [req-2986d563-2516-4ead-9d75-b9edc265bd32 req-ce36eb55-f2ab-4351-b334-c766eb8b0be6 service nova] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_rules [ 1017.528463] env[69777]: INFO networking_nsxv3.common.synchronization [req-2986d563-2516-4ead-9d75-b9edc265bd32 req-ce36eb55-f2ab-4351-b334-c766eb8b0be6 service nova] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1017.528463] env[69777]: INFO networking_nsxv3.common.synchronization [req-2986d563-2516-4ead-9d75-b9edc265bd32 req-ce36eb55-f2ab-4351-b334-c766eb8b0be6 service nova] Enqueued Resource ID: 435d3887-536a-4895-954c-5c225161069d with Priority: HIGHEST for action port [ 1017.528463] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_rules [ 1017.528463] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1017.528463] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 435d3887-536a-4895-954c-5c225161069d with Priority: HIGHEST for action port [ 1017.529465] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.529758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.529942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.530311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.530661] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.531805] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.532076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.532300] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.532581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.532810] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.533037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.533208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.533519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.533701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.533863] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.536718] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-435d3887-536a-4895-954c-5c225161069d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.536718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-435d3887-536a-4895-954c-5c225161069d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.536718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-435d3887-536a-4895-954c-5c225161069d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.536718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-435d3887-536a-4895-954c-5c225161069d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.536718] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('435d3887-536a-4895-954c-5c225161069d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.544111] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.037081] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.037427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.037465] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.038380] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 435d3887-536a-4895-954c-5c225161069d with status ACTIVE [ 1018.038571] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.038688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.038757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.038963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.039066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.039243] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.039335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.039413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.039752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.039752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.039851] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.039921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.039987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.040243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.040321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.040423] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 435d3887-536a-4895-954c-5c225161069d is going to be updated. [ 1018.047702] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.047774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.047878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.048015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.048106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.048195] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1018.075743] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.076432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.076698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.077041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.077241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.077648] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-435d3887-536a-4895-954c-5c225161069d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.092997] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.093165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.093232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.095021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.095021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.102256] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1018.542232] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.756693] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 in Status: SUCCESS [ 1018.756958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.045029] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.045029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.045029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.045506] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.045506] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.045506] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be created. [ 1019.067955] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.067955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.068209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.068320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.068463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.080404] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: UNINITIALIZED for 2s [ 1020.113190] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1020.113476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.113667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.113905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.114156] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.114284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.114385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.114573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.114667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.114770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.114877] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.617464] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.617723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.617886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.618176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.618419] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.618550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.618664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.618849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.618973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.619099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.619277] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.619793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.619793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.619793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.619793] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.620170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.620170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.620170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.620170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.620389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.620389] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.680915] env[69777]: INFO networking_nsxv3.common.synchronization [req-084420e7-9a68-4ab6-b53e-5c7485ca8934 req-11d339fc-cc9e-4de8-a482-7bbae64e6b2a tempest-ImagesTestJSON-42450789 tempest-ImagesTestJSON-42450789-project-member] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 1020.682081] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 1020.682314] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.682481] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.682585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.682863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.683164] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.683514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.683594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.683812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.683930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.684093] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.088095] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1021.088898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.089119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.089440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.089714] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.089848] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.089926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.090107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.090219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.090316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.090420] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.123232] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06bee688-2b64-4a9b-b0eb-ee4c735a9c41: rpc.has_security_group_logging(os_id): False [ 1021.142050] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.142284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.142284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.142590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.142742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.143053] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.143168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.143241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.143425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.143544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.143807] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.143942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.144163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.144366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.144502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.144776] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.144896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.144977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.145153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.145433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.145573] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1021.188927] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.189158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.189158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.189400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.189547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.189774] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.189891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.189955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.190129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.190208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.190302] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 1021.212802] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.214091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.214091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.214091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.214091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.225008] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.225205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.225304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.225558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.225701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.227452] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1021.233240] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 1021.592990] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.593164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.593238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.593458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.593624] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.593721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.593799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.593947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.594060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.594138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.594283] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.594374] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.594435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.595025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.595025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.595025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.595025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.595217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.595217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.595272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.596111] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.099205] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a80d85d-9154-4a27-bab2-481460122696: rpc.has_security_group_logging(os_id): False [ 1022.116333] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.116519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.116682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.117038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.117038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.117223] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.117323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.117382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.117575] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.117650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.118283] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.118399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.118465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.118632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.118709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.118934] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.119581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.119581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.119581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.119581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.119581] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be created. [ 1022.191368] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.191749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.191838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.192104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.192246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.205016] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1022.290242] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-360d6edb-6b38-452a-a34b-cd60cd585d9b tempest-ListServersNegativeTestJSON-690575533 tempest-ListServersNegativeTestJSON-690575533-project-member] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1022.290242] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1022.290486] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.290644] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.290712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.290960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.291259] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.291421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.291521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.292055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.292055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.292055] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.798015] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.798015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.798015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.798015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.798015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.798015] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.798015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.798015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.798015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.798015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.798015] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c already deleted. [ 1022.798015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.924335] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-605 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.924844] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.926584] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.926584] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.926584] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.926584] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.927375] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.928653] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.928885] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.929186] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.929534] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.929534] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.929534] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.929688] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.929774] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.929916] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.949032] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.949032] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.949032] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.949032] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.949032] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-462c8b38-dcb2-415e-b0c6-90aa4afe29e8 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.949032] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-462c8b38-dcb2-415e-b0c6-90aa4afe29e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.949331] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-462c8b38-dcb2-415e-b0c6-90aa4afe29e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.949634] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-462c8b38-dcb2-415e-b0c6-90aa4afe29e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.949634] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('462c8b38-dcb2-415e-b0c6-90aa4afe29e8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.247171] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1023.247609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.248145] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 1023.248304] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 deletion is rescheduled due to dependency. [ 1023.248404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.451748] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.452194] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.452194] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.452421] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.452592] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.452756] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 462c8b38-dcb2-415e-b0c6-90aa4afe29e8 not found, creating... [ 1023.453027] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.453191] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.453339] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.453570] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.453717] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.454010] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.454392] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.454392] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.455175] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.455175] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.455175] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 462c8b38-dcb2-415e-b0c6-90aa4afe29e8 is going to be created. [ 1023.475799] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.476036] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.476173] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.476453] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.476690] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.476912] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-462c8b38-dcb2-415e-b0c6-90aa4afe29e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.217561] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1024.217561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.236136] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-b7eff688-6d86-41b0-9532-ff7f17436990 service nova] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_rules [ 1024.241588] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-b7eff688-6d86-41b0-9532-ff7f17436990 service nova] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1024.241588] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-b7eff688-6d86-41b0-9532-ff7f17436990 service nova] Enqueued Resource ID: 462c8b38-dcb2-415e-b0c6-90aa4afe29e8 with Priority: HIGHEST for action port [ 1024.241588] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_rules [ 1024.241588] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1024.241588] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462c8b38-dcb2-415e-b0c6-90aa4afe29e8 with Priority: HIGHEST for action port [ 1024.241588] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.241588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.241588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.241588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.241588] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.241588] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.241588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.241588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.241588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.244664] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.244664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.244664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.244664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.244664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.244664] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.244664] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-462c8b38-dcb2-415e-b0c6-90aa4afe29e8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.244664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-462c8b38-dcb2-415e-b0c6-90aa4afe29e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.244664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-462c8b38-dcb2-415e-b0c6-90aa4afe29e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.245391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-462c8b38-dcb2-415e-b0c6-90aa4afe29e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.245391] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('462c8b38-dcb2-415e-b0c6-90aa4afe29e8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.747944] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.752012] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.752012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.752012] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 462c8b38-dcb2-415e-b0c6-90aa4afe29e8 with status ACTIVE [ 1024.752012] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.752012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.752012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.752012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.752012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.752012] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.752012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.752012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.752012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.752012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.752012] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.752814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.752814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.752814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.752814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.752814] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 462c8b38-dcb2-415e-b0c6-90aa4afe29e8 is going to be updated. [ 1024.764064] env[69777]: INFO networking_nsxv3.common.synchronization [req-08803104-05d2-489c-b794-2b4628ac6f8f req-d82abc72-20ed-400d-90ad-0ee96af5f50e tempest-ServerPasswordTestJSON-1895927954 tempest-ServerPasswordTestJSON-1895927954-project-member] Enqueued Resource ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 with Priority: HIGHEST for action security_group_members [ 1024.767550] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 with Priority: HIGHEST for action security_group_members [ 1024.767649] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-96e24b09-4a12-4902-8139-2df8e6a535e0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.767753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.767824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.768041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.768586] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.768806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.768806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.768922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.769016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.769118] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96e24b09-4a12-4902-8139-2df8e6a535e0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.773052] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.773158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.773234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.773393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.773524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.773687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-462c8b38-dcb2-415e-b0c6-90aa4afe29e8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.010822] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-3733dcf2-2847-4275-9f66-8804d508f68f tempest-ListServersNegativeTestJSON-690575533 tempest-ListServersNegativeTestJSON-690575533-project-member] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1025.012099] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1025.012481] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.012933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.251423] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.272573] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.272796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.272869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.273110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.273203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.273403] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.273502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.274452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.274715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.274858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.274997] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 is going to be updated. [ 1025.302698] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.302860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.302932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.303164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.303310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.312394] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 in Status: IN_PROGRESS for 2s [ 1025.378111] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-605 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.378111] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.378111] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.378111] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.378111] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.378111] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.378111] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.378577] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.379017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.379393] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.379838] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.380113] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.380438] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.380682] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.380915] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.381183] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.401185] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.401185] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1025.404012] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.404012] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.404012] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-294315f6-2922-47b0-9e16-26c24ad1facf taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.404012] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-294315f6-2922-47b0-9e16-26c24ad1facf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.404012] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-294315f6-2922-47b0-9e16-26c24ad1facf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.404012] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-294315f6-2922-47b0-9e16-26c24ad1facf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.404012] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('294315f6-2922-47b0-9e16-26c24ad1facf',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.755692] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.756027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.756027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.756155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.756258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.756357] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be created. [ 1025.797491] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.797610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.797688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.797887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.798090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.808885] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: UNINITIALIZED for 2s [ 1025.906272] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.906511] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.906644] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.906973] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.907091] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.907258] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 294315f6-2922-47b0-9e16-26c24ad1facf not found, creating... [ 1025.907607] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.907722] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.907878] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.908033] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.908181] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.908623] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.908713] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.908762] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.908971] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.909484] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.909683] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 294315f6-2922-47b0-9e16-26c24ad1facf is going to be created. [ 1025.942961] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.942961] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.942961] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.942961] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.943170] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.943729] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-294315f6-2922-47b0-9e16-26c24ad1facf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.993717] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-f749a7dd-51b6-4bca-b9ac-8426c61ae205 service nova] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_rules [ 1026.993988] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-f749a7dd-51b6-4bca-b9ac-8426c61ae205 service nova] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1026.993988] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-f749a7dd-51b6-4bca-b9ac-8426c61ae205 service nova] Enqueued Resource ID: 294315f6-2922-47b0-9e16-26c24ad1facf with Priority: HIGHEST for action port [ 1026.996118] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_rules [ 1026.996118] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1026.996118] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 294315f6-2922-47b0-9e16-26c24ad1facf with Priority: HIGHEST for action port [ 1026.996118] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.996118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.996118] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.996118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.996118] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-294315f6-2922-47b0-9e16-26c24ad1facf taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.996118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-294315f6-2922-47b0-9e16-26c24ad1facf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.996118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-294315f6-2922-47b0-9e16-26c24ad1facf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.996118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-294315f6-2922-47b0-9e16-26c24ad1facf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.996118] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('294315f6-2922-47b0-9e16-26c24ad1facf',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.322334] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 in Status: SUCCESS [ 1027.322334] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96e24b09-4a12-4902-8139-2df8e6a535e0 deletion is rescheduled due to dependency. [ 1027.322334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96e24b09-4a12-4902-8139-2df8e6a535e0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.501024] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 294315f6-2922-47b0-9e16-26c24ad1facf with status ACTIVE [ 1027.501024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.501024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.501024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.501024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.501024] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 294315f6-2922-47b0-9e16-26c24ad1facf is going to be updated. [ 1027.522567] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.522567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.522567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.522567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.522567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.522567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-294315f6-2922-47b0-9e16-26c24ad1facf" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.699124] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-ae229840-da97-4817-b823-9291a8692f2d tempest-ListServersNegativeTestJSON-690575533 tempest-ListServersNegativeTestJSON-690575533-project-member] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1027.699124] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1027.699124] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.699124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.818300] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1027.818531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.818707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.818925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.819177] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.819323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.819395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.819580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.819739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.819739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.819841] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.821667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.821957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.822297] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.822458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.822560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.822769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.822894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.823024] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.919351] env[69777]: INFO networking_nsxv3.common.synchronization [req-e13d0c79-b5a7-4b0a-9105-7cb820ddc78c req-4cc6dca5-4451-4f84-b298-946eeee42cb7 tempest-ServerRescueNegativeTestJSON-1534204294 tempest-ServerRescueNegativeTestJSON-1534204294-project-member] Enqueued Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_members [ 1027.919963] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGHEST for action security_group_members [ 1027.920287] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aba63da-4cec-4d01-bddd-3245f04bb8e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.920406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.920545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.920688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.920846] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.920945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.921016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.921254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.921400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.921460] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.046226] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-605 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.046530] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.046789] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.046977] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.047300] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.047772] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.047992] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.048333] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.048603] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.048913] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1028.049142] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.049352] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.049769] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.049769] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1028.049905] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.050124] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.069117] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.069409] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1028.069750] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.070080] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-605" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.070550] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-da9e67ca-8a89-44de-8177-111df054e7bc taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.071126] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-da9e67ca-8a89-44de-8177-111df054e7bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.071322] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-da9e67ca-8a89-44de-8177-111df054e7bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.071710] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-da9e67ca-8a89-44de-8177-111df054e7bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.071914] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da9e67ca-8a89-44de-8177-111df054e7bc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.322639] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.323139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.324493] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.425049] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.425049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.425049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.425049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.425049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.425049] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.425352] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.425352] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.428640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.428856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.428969] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 is going to be updated. [ 1028.454103] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.454248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.454318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.454527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.454669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.462170] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 in Status: IN_PROGRESS for 2s [ 1028.575376] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.575376] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.575376] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.575376] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.575376] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.575639] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port da9e67ca-8a89-44de-8177-111df054e7bc not found, creating... [ 1028.575768] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.576344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.576344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.576344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.576344] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.577045] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.577045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.577045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.577275] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.577275] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.577419] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: da9e67ca-8a89-44de-8177-111df054e7bc is going to be created. [ 1028.605925] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.606356] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.606507] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.606776] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.607362] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.607644] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-da9e67ca-8a89-44de-8177-111df054e7bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.828534] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.333902] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.334173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.334248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.334501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.334571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.334676] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be updated. [ 1029.361283] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.361423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.361502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.361747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.361923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.375227] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: IN_PROGRESS for 2s [ 1029.457845] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-db588a14-2cf5-4f9e-98f4-0da26c921dbc service nova] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_rules [ 1029.458502] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-db588a14-2cf5-4f9e-98f4-0da26c921dbc service nova] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1029.458664] env[69777]: INFO networking_nsxv3.common.synchronization [req-303a356b-d330-427b-822d-dfa54ad6eb15 req-db588a14-2cf5-4f9e-98f4-0da26c921dbc service nova] Enqueued Resource ID: da9e67ca-8a89-44de-8177-111df054e7bc with Priority: HIGHEST for action port [ 1029.459224] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_rules [ 1029.459370] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1029.459464] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da9e67ca-8a89-44de-8177-111df054e7bc with Priority: HIGHEST for action port [ 1029.459923] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.459923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.464637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.464637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.464637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-da9e67ca-8a89-44de-8177-111df054e7bc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.464637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da9e67ca-8a89-44de-8177-111df054e7bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.464637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da9e67ca-8a89-44de-8177-111df054e7bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.464637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da9e67ca-8a89-44de-8177-111df054e7bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.464637] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da9e67ca-8a89-44de-8177-111df054e7bc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.969017] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da9e67ca-8a89-44de-8177-111df054e7bc with status ACTIVE [ 1029.969455] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.969627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.969704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.969921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.970033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.970444] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.970444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.970444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.970747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.970747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.970861] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.970948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.971026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.971242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.971242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.971347] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da9e67ca-8a89-44de-8177-111df054e7bc is going to be updated. [ 1029.994207] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.994207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.994207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.994635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.994799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.995010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da9e67ca-8a89-44de-8177-111df054e7bc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.471452] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 in Status: SUCCESS [ 1030.471717] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 deletion is rescheduled due to dependency. [ 1030.471915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.384613] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1031.384902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.385119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.385334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.385832] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.385832] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.385832] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.386054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.386054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.386119] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.892032] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.240308] env[69777]: INFO networking_nsxv3.common.synchronization [req-8221753b-62f3-437a-a77d-163357532194 req-035fdfa3-5ac7-4b54-ac0d-b628db9932c0 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1032.240961] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1032.241255] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.241380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.241448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.241651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.241802] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.242282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.242282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.242282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.242282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.242282] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.393383] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.744042] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.746983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.746983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.746983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.746983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.746983] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.746983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.746983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.746983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.746983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.746983] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1032.772130] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.772296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.772337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.772538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.772679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.780663] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1032.896876] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.897245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.897245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.901017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.901017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.901017] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be updated. [ 1032.926561] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.926561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.926561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.926561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.926561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.938943] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: IN_PROGRESS for 2s [ 1034.789992] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1034.790288] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 deletion is rescheduled due to dependency. [ 1034.790365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.951496] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1034.951496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.951496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.951496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.951496] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.951496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.951496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.951496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.951496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.951496] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.453728] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.956863] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.459233] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.459233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.459233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.459233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.459233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.459410] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be updated. [ 1036.486130] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.486288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.486345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.486564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.486747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.497023] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: IN_PROGRESS for 2s [ 1037.241773] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1037.242091] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1037.261137] env[69777]: INFO networking_nsxv3.common.synchronization [req-0ab7dfed-dba4-44e6-88cf-ee6dc0218516 req-eb9ad84e-b0bd-4493-8010-0d8ce286fa9c tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_members [ 1037.261196] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 with Priority: HIGHEST for action security_group_members [ 1037.261489] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-15fc107d-52a0-4aa7-83cd-a96824b186f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.261618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.261675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.262582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.262582] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.262582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.262582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.262582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.262582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.262582] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15fc107d-52a0-4aa7-83cd-a96824b186f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.767950] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.767950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.767950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.767950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.767950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.767950] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.767950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.767950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.767950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.767950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.767950] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 is going to be updated. [ 1037.794437] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.794624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.794746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.795037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.795187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.804521] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 in Status: IN_PROGRESS for 2s [ 1038.504195] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1038.504195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.504195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.505336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.505336] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.505336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.505336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.505336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.505336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.505336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.505336] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.505336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.505336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.505795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.505795] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.505795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.505795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.505953] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.505989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.508283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.508283] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.512434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.512434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.512434] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.512434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.512434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.512434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.512434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.512434] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.512434] env[69777]: INFO networking_nsxv3.common.synchronization [None req-4f5f1e53-5cd7-419e-8cff-059946d10428 tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_rules [ 1038.514503] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_rules [ 1038.514503] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.514503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.514503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.514503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.514503] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.790820] env[69777]: INFO networking_nsxv3.common.synchronization [None req-d49021f2-7831-4dbf-ad36-198af55e5e8d tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_rules [ 1038.791895] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_rules [ 1038.792318] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.793025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.841231] env[69777]: INFO networking_nsxv3.common.synchronization [None req-88ef88f2-3eec-43e2-a647-a1c834051d7b None None] Enqueued Resource ID: 66a1131c-feaf-42a4-807a-312403a9a44f with Priority: HIGHEST for action port [ 1038.842644] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a1131c-feaf-42a4-807a-312403a9a44f with Priority: HIGHEST for action port [ 1038.843080] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-66a1131c-feaf-42a4-807a-312403a9a44f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.843241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66a1131c-feaf-42a4-807a-312403a9a44f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.843335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66a1131c-feaf-42a4-807a-312403a9a44f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.843620] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66a1131c-feaf-42a4-807a-312403a9a44f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.845755] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66a1131c-feaf-42a4-807a-312403a9a44f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.014703] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54f2e457-46a8-40bd-9513-a556b213a51c: rpc.has_security_group_logging(os_id): False [ 1039.017366] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.035831] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.036159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.036244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.036500] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.036594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.036802] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.036902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.036965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.037142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.037225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.037403] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.037551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.037621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.037803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.037888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.038128] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.038238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.038307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.038489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.038572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.038666] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be created. [ 1039.040721] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.040889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.040889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.041634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.041634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.041634] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 already deleted. [ 1039.041634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.042146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.042223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.042333] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.094534] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.096162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.096162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.096162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.096162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.107618] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: IN_PROGRESS for 2s [ 1039.348577] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66a1131c-feaf-42a4-807a-312403a9a44f [ 1039.348577] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.348577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.348577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.348577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.348577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.348577] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66a1131c-feaf-42a4-807a-312403a9a44f already deleted. [ 1039.348577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66a1131c-feaf-42a4-807a-312403a9a44f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.520135] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.562435] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.562537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.562607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.562845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.563714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.563714] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 already deleted. [ 1039.563714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.816036] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 in Status: SUCCESS [ 1039.816318] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15fc107d-52a0-4aa7-83cd-a96824b186f6 deletion is rescheduled due to dependency. [ 1039.816437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15fc107d-52a0-4aa7-83cd-a96824b186f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.025282] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.025446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.025520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.025745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.025849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.025962] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be updated. [ 1040.056196] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.056376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.056420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.057167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.057167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.066517] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: IN_PROGRESS for 2s [ 1040.930874] env[69777]: INFO networking_nsxv3.common.synchronization [req-1c7b8d32-baf0-45ef-9fc5-997f23fa58e7 req-2f752fca-713f-4497-a9f9-090618ffd1a6 tempest-ImagesOneServerNegativeTestJSON-1912736822 tempest-ImagesOneServerNegativeTestJSON-1912736822-project-member] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 1040.931448] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 1040.931762] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.931895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.933568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.933943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.934501] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.934501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.934501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.935256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.935256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.935256] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.123097] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1041.123281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.123495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.123757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.123856] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.428799] env[69777]: INFO networking_nsxv3.common.synchronization [None req-205efec5-3eae-4621-8708-a3196176ecb7 None None] Enqueued Resource ID: df96d916-0904-4be6-bd88-5b6468255b6a with Priority: HIGHEST for action port [ 1041.429668] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df96d916-0904-4be6-bd88-5b6468255b6a with Priority: HIGHEST for action port [ 1041.431018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-df96d916-0904-4be6-bd88-5b6468255b6a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.431018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df96d916-0904-4be6-bd88-5b6468255b6a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.431018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df96d916-0904-4be6-bd88-5b6468255b6a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.431018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df96d916-0904-4be6-bd88-5b6468255b6a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.431018] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df96d916-0904-4be6-bd88-5b6468255b6a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.440128] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.440128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.440128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.440128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.440128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.440128] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.440128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.440128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.446486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.446486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.446486] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be updated. [ 1041.468940] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.469096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.469167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.469381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.469525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.478089] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: IN_PROGRESS for 2s [ 1041.566034] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-894 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.566034] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.566034] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.566034] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.566034] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.566034] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.566034] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.566509] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.566882] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.567248] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.567480] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.567711] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.567938] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.568700] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.573745] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.573745] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.593398] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.594181] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.594470] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.595477] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-894" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.596453] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-f6f7a0a2-cdec-4250-b4af-f88014bb5ed5 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.596453] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-f6f7a0a2-cdec-4250-b4af-f88014bb5ed5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.596453] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-f6f7a0a2-cdec-4250-b4af-f88014bb5ed5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.596453] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-f6f7a0a2-cdec-4250-b4af-f88014bb5ed5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.596453] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f7a0a2-cdec-4250-b4af-f88014bb5ed5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.626883] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.626883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.937461] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df96d916-0904-4be6-bd88-5b6468255b6a [ 1041.937461] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.937461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.937461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.937461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.937461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.937461] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df96d916-0904-4be6-bd88-5b6468255b6a already deleted. [ 1041.937461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df96d916-0904-4be6-bd88-5b6468255b6a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.080177] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1042.080177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.080177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.080177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.080177] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.080177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.080177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.080177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.080177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.080177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.080177] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.099953] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.100155] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.100207] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.100869] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.100869] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.101065] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port f6f7a0a2-cdec-4250-b4af-f88014bb5ed5 not found, creating... [ 1042.101248] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.101399] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.101757] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.101757] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.103258] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.104424] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.104424] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.104424] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.104927] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.105112] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.106101] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: f6f7a0a2-cdec-4250-b4af-f88014bb5ed5 is going to be created. [ 1042.128972] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.129168] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.129329] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.129682] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.129884] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.130143] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-f6f7a0a2-cdec-4250-b4af-f88014bb5ed5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.473510] env[69777]: INFO networking_nsxv3.common.synchronization [req-19c6b3d1-bca2-45c9-b493-2c8720c079a7 req-65542b44-7c42-4e27-a58d-6209dbe9c625 tempest-ListServersNegativeTestJSON-690575533 tempest-ListServersNegativeTestJSON-690575533-project-member] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1042.474026] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1042.474339] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.474467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.474536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.474735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.474889] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.474987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.475076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.475218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.475296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.475955] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.585419] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.585419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.981018] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.287361] env[69777]: INFO networking_nsxv3.common.synchronization [req-1c7b8d32-baf0-45ef-9fc5-997f23fa58e7 req-a51fc41a-b259-484c-8633-6abeee6c3d44 service nova] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_rules [ 1043.287361] env[69777]: INFO networking_nsxv3.common.synchronization [req-1c7b8d32-baf0-45ef-9fc5-997f23fa58e7 req-a51fc41a-b259-484c-8633-6abeee6c3d44 service nova] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 1043.287528] env[69777]: INFO networking_nsxv3.common.synchronization [req-1c7b8d32-baf0-45ef-9fc5-997f23fa58e7 req-a51fc41a-b259-484c-8633-6abeee6c3d44 service nova] Enqueued Resource ID: f6f7a0a2-cdec-4250-b4af-f88014bb5ed5 with Priority: HIGHEST for action port [ 1043.290434] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_rules [ 1043.291451] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 1043.291451] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f7a0a2-cdec-4250-b4af-f88014bb5ed5 with Priority: HIGHEST for action port [ 1043.291656] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.291720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.291771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.292138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.292138] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.292948] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.293251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.293341] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6f7a0a2-cdec-4250-b4af-f88014bb5ed5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.293409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6f7a0a2-cdec-4250-b4af-f88014bb5ed5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.293447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6f7a0a2-cdec-4250-b4af-f88014bb5ed5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.293655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6f7a0a2-cdec-4250-b4af-f88014bb5ed5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.293978] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f7a0a2-cdec-4250-b4af-f88014bb5ed5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.482905] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.493107] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: SUCCESS [ 1043.493291] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 deletion is rescheduled due to dependency. [ 1043.493400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.493871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.494112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.494298] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.495098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.495098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.495098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.495098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.495098] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.797548] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.797548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.801503] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6f7a0a2-cdec-4250-b4af-f88014bb5ed5 with status ACTIVE [ 1043.801503] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.801620] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.801620] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.802769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.802769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.802769] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.802769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.802769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.802769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.802769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.802769] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.802769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.802769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.803175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.803175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.803175] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6f7a0a2-cdec-4250-b4af-f88014bb5ed5 is going to be updated. [ 1043.825605] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.825605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.825605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.825853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.825962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.826139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6f7a0a2-cdec-4250-b4af-f88014bb5ed5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.984920] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.984920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.985230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.985230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.985378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.985411] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be updated. [ 1044.002409] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.015306] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.015514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.015634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.015873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.016038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.025735] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: IN_PROGRESS for 2s [ 1044.505132] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.010401] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.010741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.010741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.010741] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be updated. [ 1045.042040] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.042040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.042040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.042040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.042040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.051499] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: IN_PROGRESS for 2s [ 1046.038532] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1046.038861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.038951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.039231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.039429] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.039548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.039614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.039802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.039888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.039975] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.040144] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.040226] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.040391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.040456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.040649] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.040797] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.040839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.041558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.041709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.041810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.042012] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.106204] env[69777]: INFO networking_nsxv3.common.synchronization [req-462f11dd-e9c3-4a4e-9e1e-23706a8c8757 req-b8ef5fa4-a325-4b83-a617-76875dd8d04f tempest-ServersTestManualDisk-959404340 tempest-ServersTestManualDisk-959404340-project-member] Enqueued Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_members [ 1046.106783] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGHEST for action security_group_members [ 1046.108450] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad5575ce-f5cd-4af5-9757-424d93034877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.108683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.109048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.109753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.110536] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.110767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.110927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.111223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.111657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.111851] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.546035] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54f2e457-46a8-40bd-9513-a556b213a51c: rpc.has_security_group_logging(os_id): False [ 1046.561966] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.563604] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.563675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.563914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.564031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.564321] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.564429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.564507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.564664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.564754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.564938] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.565072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.565137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.565294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.565372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.565576] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.565681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.565748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.569030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.569030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.569030] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be updated. [ 1046.616013] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.616269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.616388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.616655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.616779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.617008] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.617163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.617240] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.617429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.617515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.617611] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad5575ce-f5cd-4af5-9757-424d93034877 is going to be updated. [ 1046.632571] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.632730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.632906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.633031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.633204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.648112] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.648265] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.648310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.648514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.651089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.652748] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: IN_PROGRESS for 2s [ 1046.656253] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad5575ce-f5cd-4af5-9757-424d93034877 in Status: IN_PROGRESS for 2s [ 1047.061923] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: SUCCESS [ 1047.064156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.064342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.064573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.064917] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.065017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.065102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.065355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.065499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.065652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.065767] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.400145] env[69777]: INFO networking_nsxv3.common.synchronization [None req-81d90088-e2c9-4f4b-bf8c-639b088e1c46 None None] Enqueued Resource ID: 0ddfef29-2f63-49e3-9523-1b2d0726767d with Priority: HIGHEST for action port [ 1047.402587] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ddfef29-2f63-49e3-9523-1b2d0726767d with Priority: HIGHEST for action port [ 1047.402587] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ddfef29-2f63-49e3-9523-1b2d0726767d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.404581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ddfef29-2f63-49e3-9523-1b2d0726767d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.404581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ddfef29-2f63-49e3-9523-1b2d0726767d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.404581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ddfef29-2f63-49e3-9523-1b2d0726767d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.404581] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ddfef29-2f63-49e3-9523-1b2d0726767d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.569478] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.570658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.570735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.571051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.571268] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.571383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.571450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.571626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.571730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.571822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.571991] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.572101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.572153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.572298] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.572642] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.572642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.572642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.572747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.572777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.572847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.572941] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.906929] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ddfef29-2f63-49e3-9523-1b2d0726767d [ 1047.907189] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.907322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.907392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.907610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.907698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.907794] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ddfef29-2f63-49e3-9523-1b2d0726767d already deleted. [ 1047.907877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ddfef29-2f63-49e3-9523-1b2d0726767d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.082299] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ceaf97c-1feb-4a95-a759-71b6308c5c38: rpc.has_security_group_logging(os_id): False [ 1048.103738] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.103921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.104079] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.104201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.104308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.104511] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.104621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.105215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.105215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.105215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.105215] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.105215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.105560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.105560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.105560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.105756] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.105756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.105960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.105960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.105960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.106239] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be updated. [ 1048.167349] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.167511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.167574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.167786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.167927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.188070] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: IN_PROGRESS for 2s [ 1048.231132] env[69777]: INFO networking_nsxv3.common.synchronization [None req-01b86aad-818f-48af-aa66-30ac2cb1f617 None None] Enqueued Resource ID: 5d062dc5-016a-422e-8ace-9e98dfcdde83 with Priority: HIGHEST for action port [ 1048.231402] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d062dc5-016a-422e-8ace-9e98dfcdde83 with Priority: HIGHEST for action port [ 1048.231978] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d062dc5-016a-422e-8ace-9e98dfcdde83 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.232151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d062dc5-016a-422e-8ace-9e98dfcdde83" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.232206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d062dc5-016a-422e-8ace-9e98dfcdde83" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.232465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d062dc5-016a-422e-8ace-9e98dfcdde83" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.232559] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d062dc5-016a-422e-8ace-9e98dfcdde83',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.666124] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad5575ce-f5cd-4af5-9757-424d93034877 in Status: SUCCESS [ 1048.666471] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad5575ce-f5cd-4af5-9757-424d93034877 deletion is rescheduled due to dependency. [ 1048.666471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.669111] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1048.669253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.669418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.669634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.669746] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.743037] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d062dc5-016a-422e-8ace-9e98dfcdde83 [ 1048.743037] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.743246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.743246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.743365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.743413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.743509] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d062dc5-016a-422e-8ace-9e98dfcdde83 already deleted. [ 1048.743678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d062dc5-016a-422e-8ace-9e98dfcdde83" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.174404] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.174668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.174668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.174881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.175438] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.175438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.175438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.175438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.175438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.175694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.175694] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.681510] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.681510] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.681510] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.681510] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.681510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.682392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.682392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.682392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.682392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.682392] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.186046] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54f2e457-46a8-40bd-9513-a556b213a51c: rpc.has_security_group_logging(os_id): False [ 1050.201821] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.201983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.202068] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.202317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.202482] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.203102] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.203102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.203102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.203102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.204381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.204381] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.204381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.204381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.204643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.204643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.204772] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.204840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.204890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.205063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.205150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.205244] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be updated. [ 1050.206961] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: SUCCESS [ 1050.207175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.273592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.273592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.273592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.273592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.273592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.301668] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: IN_PROGRESS for 2s [ 1050.303589] env[69777]: INFO networking_nsxv3.common.synchronization [None req-fbd4e99d-88d1-4067-aa3e-c9eb1b73ffba None None] Enqueued Resource ID: a2ca8b1c-e0ed-4f57-ba9a-31bf0544d51d with Priority: HIGHEST for action port [ 1050.304127] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ca8b1c-e0ed-4f57-ba9a-31bf0544d51d with Priority: HIGHEST for action port [ 1050.306989] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2ca8b1c-e0ed-4f57-ba9a-31bf0544d51d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.307135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2ca8b1c-e0ed-4f57-ba9a-31bf0544d51d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.307373] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2ca8b1c-e0ed-4f57-ba9a-31bf0544d51d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.310144] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2ca8b1c-e0ed-4f57-ba9a-31bf0544d51d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.310245] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ca8b1c-e0ed-4f57-ba9a-31bf0544d51d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.316008] env[69777]: INFO networking_nsxv3.common.synchronization [None req-3477e8d0-2d86-400d-9b6c-4b2be1c58942 None None] Enqueued Resource ID: 49bd9e5a-c989-4e94-863d-fea67aec49ca with Priority: HIGHEST for action port [ 1050.316205] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bd9e5a-c989-4e94-863d-fea67aec49ca with Priority: HIGHEST for action port [ 1050.316526] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-49bd9e5a-c989-4e94-863d-fea67aec49ca taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.316667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49bd9e5a-c989-4e94-863d-fea67aec49ca" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.316728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49bd9e5a-c989-4e94-863d-fea67aec49ca" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.316970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49bd9e5a-c989-4e94-863d-fea67aec49ca" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.317080] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49bd9e5a-c989-4e94-863d-fea67aec49ca',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.817107] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2ca8b1c-e0ed-4f57-ba9a-31bf0544d51d [ 1050.817337] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.817465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.817533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.817837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.817940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.818048] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2ca8b1c-e0ed-4f57-ba9a-31bf0544d51d already deleted. [ 1050.818129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2ca8b1c-e0ed-4f57-ba9a-31bf0544d51d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.819437] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49bd9e5a-c989-4e94-863d-fea67aec49ca [ 1050.819604] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.819765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.819831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.819989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.820076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.820159] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49bd9e5a-c989-4e94-863d-fea67aec49ca already deleted. [ 1050.820233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49bd9e5a-c989-4e94-863d-fea67aec49ca" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.317967] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1052.318259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.762266] env[69777]: INFO networking_nsxv3.common.synchronization [req-7e16ede3-28f6-4d2d-89e0-ddbdfc51ad26 req-dcce44a8-3eb3-4c3b-bf89-7231687a7ff0 tempest-ImagesOneServerNegativeTestJSON-1912736822 tempest-ImagesOneServerNegativeTestJSON-1912736822-project-member] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 1053.762966] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGHEST for action security_group_members [ 1053.764863] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.765015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.765015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.765247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.765440] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.765547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.765626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.765851] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.765904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.765998] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.269330] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.269718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.272618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.272618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.272618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.272618] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.272618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.272618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.272618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.272618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.272618] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be updated. [ 1054.298148] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.299177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.299276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.299522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.300122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.311732] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: IN_PROGRESS for 2s [ 1056.322610] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 in Status: SUCCESS [ 1056.322887] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 deletion is rescheduled due to dependency. [ 1056.322887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.247059] env[69777]: INFO networking_nsxv3.common.synchronization [req-0bfd1c61-b152-4d85-be6f-08ff7217d952 req-a9c9ee58-a5fb-47e4-99b0-083da9a15228 tempest-ServerActionsTestOtherB-1106354566 tempest-ServerActionsTestOtherB-1106354566-project-member] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1057.247612] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1057.248021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.248160] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.248543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.248543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.248649] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.248765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.248823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.249009] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.249127] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.249238] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.601189] env[69777]: INFO networking_nsxv3.common.synchronization [req-f3014939-57a2-47c7-8f14-2f82ce2fe4f0 req-0007ca54-0750-42ff-9ac2-4ada61319713 tempest-ImagesTestJSON-42450789 tempest-ImagesTestJSON-42450789-project-member] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 1057.601710] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 1057.602013] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.602150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.602198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.602380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.602524] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.602615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.602673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.602839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.602918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.603297] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.753140] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.753140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.753140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.753140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.753140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.753140] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.753140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.753140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.753140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.753140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.753140] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 1057.777990] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.778835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.779016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.779779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.779996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.789245] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1057.940795] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.941054] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.941233] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.941626] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.941921] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.942122] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.942250] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.942476] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.942626] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.942846] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1057.942966] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.943093] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.943208] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.943322] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1057.943432] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.943565] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.962563] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.962876] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1057.963148] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.963369] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-362" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.963769] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-7438d7c2-1365-4853-b8a0-c5ff3cca495c taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.964018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-7438d7c2-1365-4853-b8a0-c5ff3cca495c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.964198] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-7438d7c2-1365-4853-b8a0-c5ff3cca495c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.964529] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-7438d7c2-1365-4853-b8a0-c5ff3cca495c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.964716] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7438d7c2-1365-4853-b8a0-c5ff3cca495c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.107312] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.107483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.107583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.107762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.107856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.108062] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.108167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.108232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.108368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.108443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.108532] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 1058.137601] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.137800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.137856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.138100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.138270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.146302] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 1058.467653] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.467925] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.468092] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.468385] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.468739] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.468739] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 7438d7c2-1365-4853-b8a0-c5ff3cca495c not found, creating... [ 1058.468973] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.469149] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.469273] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.469494] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.469649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.469964] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.470612] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.470885] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.471223] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.471223] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.471290] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 7438d7c2-1365-4853-b8a0-c5ff3cca495c is going to be created. [ 1058.494552] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.494726] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.494854] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.495220] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.495416] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.495858] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-7438d7c2-1365-4853-b8a0-c5ff3cca495c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.199029] env[69777]: INFO networking_nsxv3.common.synchronization [req-f3014939-57a2-47c7-8f14-2f82ce2fe4f0 req-7f80428d-c5e7-4d34-98a1-779c0daeb3b9 service nova] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_rules [ 1059.199327] env[69777]: INFO networking_nsxv3.common.synchronization [req-f3014939-57a2-47c7-8f14-2f82ce2fe4f0 req-7f80428d-c5e7-4d34-98a1-779c0daeb3b9 service nova] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 1059.199327] env[69777]: INFO networking_nsxv3.common.synchronization [req-f3014939-57a2-47c7-8f14-2f82ce2fe4f0 req-7f80428d-c5e7-4d34-98a1-779c0daeb3b9 service nova] Enqueued Resource ID: 7438d7c2-1365-4853-b8a0-c5ff3cca495c with Priority: HIGHEST for action port [ 1059.199540] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_rules [ 1059.199668] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 1059.199790] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7438d7c2-1365-4853-b8a0-c5ff3cca495c with Priority: HIGHEST for action port [ 1059.200369] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.200476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.200539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.200783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.200883] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.202034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.202110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.202302] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-7438d7c2-1365-4853-b8a0-c5ff3cca495c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.202399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7438d7c2-1365-4853-b8a0-c5ff3cca495c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.202460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7438d7c2-1365-4853-b8a0-c5ff3cca495c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.202627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7438d7c2-1365-4853-b8a0-c5ff3cca495c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.202700] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7438d7c2-1365-4853-b8a0-c5ff3cca495c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.704869] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.705572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.705572] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7438d7c2-1365-4853-b8a0-c5ff3cca495c with status ACTIVE [ 1059.705812] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.705812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.705952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.706198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.706282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.706539] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.706701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.706816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.707085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.707209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.707463] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.707675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.707772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.708217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.708217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.708217] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7438d7c2-1365-4853-b8a0-c5ff3cca495c is going to be updated. [ 1059.730128] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.730301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.730338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.730541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.730677] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.730869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7438d7c2-1365-4853-b8a0-c5ff3cca495c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.808585] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1059.808720] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 deletion is rescheduled due to dependency. [ 1059.808836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.155655] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 1060.155853] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 deletion is rescheduled due to dependency. [ 1060.155967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.156149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.156371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.156563] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.156680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.156745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.156905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.156986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.157096] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.659269] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.182528] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.666962] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.667254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.667254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.667420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.667509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.667606] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 1061.694596] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.694821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.694821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.695024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.695170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.704850] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 1063.716047] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 1063.716047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.716423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.716423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.716629] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.716749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.716816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.716967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.717062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.717152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.717243] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.049282] env[69777]: INFO networking_nsxv3.common.synchronization [req-a001973c-eb2c-4b78-8d8f-0d8f7ea68746 req-1ff72279-4687-4dbe-aa63-484d8db4a4eb tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1064.049923] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1064.050305] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.050419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.050484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.050683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.050837] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.050929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.051013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.051146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.051229] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.051321] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.220865] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.220865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.220865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.220865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.220865] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.220865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.220865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.220865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.220865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.220865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.220865] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.221317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.221317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.221317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.221317] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.221462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.221462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.221527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.223710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.223710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.223710] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.455228] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.455422] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.455554] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.455826] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.456101] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.456265] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.456387] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.456608] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.456757] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.456972] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.457269] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.457403] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.457520] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.457638] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.457752] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.457890] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.476722] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.476895] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.477093] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.477283] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.477573] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-a49ed3a6-840d-41cd-a889-6f8bf047c0e3 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.477746] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-a49ed3a6-840d-41cd-a889-6f8bf047c0e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.477872] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-a49ed3a6-840d-41cd-a889-6f8bf047c0e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.478194] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-a49ed3a6-840d-41cd-a889-6f8bf047c0e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.478337] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a49ed3a6-840d-41cd-a889-6f8bf047c0e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.553070] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.726107] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c31a3d66-3f9b-4509-bdc2-763f23333743: rpc.has_security_group_logging(os_id): False [ 1064.744048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.744229] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.744301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.744819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.744819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.744950] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.744950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.745056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.745186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.745258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.745462] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.745557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.745619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.745762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.745839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.746024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.746119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.746182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.746322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.746436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.746479] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 1064.803104] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.803104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.803297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.803335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.803460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.816684] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 1064.980273] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.980561] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.980704] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.981017] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.981184] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.981346] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port a49ed3a6-840d-41cd-a889-6f8bf047c0e3 not found, creating... [ 1064.981605] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.981765] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.981889] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.982125] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.982259] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.982542] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.982703] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.982827] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.983060] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.983201] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.983345] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: a49ed3a6-840d-41cd-a889-6f8bf047c0e3 is going to be created. [ 1065.005881] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.006100] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.006234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.006491] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.006724] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.006956] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-a49ed3a6-840d-41cd-a889-6f8bf047c0e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.055738] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.558537] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.558537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.558537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.558537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.558537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.558537] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1065.591168] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.591357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.591447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.591734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.591930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.601343] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1065.722481] env[69777]: INFO networking_nsxv3.common.synchronization [req-a001973c-eb2c-4b78-8d8f-0d8f7ea68746 req-d3be509f-551e-475c-ac2d-ff38275201cd service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 1065.722594] env[69777]: INFO networking_nsxv3.common.synchronization [req-a001973c-eb2c-4b78-8d8f-0d8f7ea68746 req-d3be509f-551e-475c-ac2d-ff38275201cd service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1065.722747] env[69777]: INFO networking_nsxv3.common.synchronization [req-a001973c-eb2c-4b78-8d8f-0d8f7ea68746 req-d3be509f-551e-475c-ac2d-ff38275201cd service nova] Enqueued Resource ID: a49ed3a6-840d-41cd-a889-6f8bf047c0e3 with Priority: HIGHEST for action port [ 1065.722889] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 1065.722970] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1065.723083] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49ed3a6-840d-41cd-a889-6f8bf047c0e3 with Priority: HIGHEST for action port [ 1065.723952] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.724264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.724348] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.725213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.725213] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.725584] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.726208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.726208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a49ed3a6-840d-41cd-a889-6f8bf047c0e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.726208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a49ed3a6-840d-41cd-a889-6f8bf047c0e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.726208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a49ed3a6-840d-41cd-a889-6f8bf047c0e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.726208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a49ed3a6-840d-41cd-a889-6f8bf047c0e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.726632] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a49ed3a6-840d-41cd-a889-6f8bf047c0e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.231179] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.231179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.231179] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a49ed3a6-840d-41cd-a889-6f8bf047c0e3 with status ACTIVE [ 1066.231179] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.231179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.231179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.231179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.231179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.231179] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.231179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.231179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.231179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.231179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.231179] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.231684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.231684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.231684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.231684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.231684] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a49ed3a6-840d-41cd-a889-6f8bf047c0e3 is going to be updated. [ 1066.262126] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.264817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.265552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.265978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.266323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.266589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a49ed3a6-840d-41cd-a889-6f8bf047c0e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.833972] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 1066.834281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.090056] env[69777]: INFO networking_nsxv3.common.synchronization [None req-37ec0be8-ba75-47e7-a4d1-898306812d1b tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: aa834c62-c8fe-4843-9588-e8c0a7d6141b with Priority: HIGHEST for action security_group_rules [ 1067.093506] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa834c62-c8fe-4843-9588-e8c0a7d6141b with Priority: HIGHEST for action security_group_rules [ 1067.094069] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa834c62-c8fe-4843-9588-e8c0a7d6141b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.094350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa834c62-c8fe-4843-9588-e8c0a7d6141b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.094539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa834c62-c8fe-4843-9588-e8c0a7d6141b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.094951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa834c62-c8fe-4843-9588-e8c0a7d6141b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.095054] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa834c62-c8fe-4843-9588-e8c0a7d6141b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.214340] env[69777]: INFO networking_nsxv3.common.synchronization [None req-22d6fc5a-a5ad-4c27-b5d0-bb908b35c2e3 tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: aa834c62-c8fe-4843-9588-e8c0a7d6141b with Priority: HIGHEST for action security_group_rules [ 1067.214891] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa834c62-c8fe-4843-9588-e8c0a7d6141b with Priority: HIGHEST for action security_group_rules [ 1067.215228] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa834c62-c8fe-4843-9588-e8c0a7d6141b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.215329] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa834c62-c8fe-4843-9588-e8c0a7d6141b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.610325] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1067.610557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.610765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.611039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.611205] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.611273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.611355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.611456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.611589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.611638] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.615404] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.615525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.615584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.615738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.615819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.615909] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa834c62-c8fe-4843-9588-e8c0a7d6141b already deleted. [ 1067.615988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa834c62-c8fe-4843-9588-e8c0a7d6141b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.616131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa834c62-c8fe-4843-9588-e8c0a7d6141b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.616277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa834c62-c8fe-4843-9588-e8c0a7d6141b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.616357] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa834c62-c8fe-4843-9588-e8c0a7d6141b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.113594] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.136340] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.136544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.136636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.136926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.137076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.137211] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa834c62-c8fe-4843-9588-e8c0a7d6141b already deleted. [ 1068.137341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa834c62-c8fe-4843-9588-e8c0a7d6141b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.615698] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.120237] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.120577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.120577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.120670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.120754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.120854] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1069.149844] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.150301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.150564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.150794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.151038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.160483] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1070.115834] env[69777]: INFO networking_nsxv3.common.synchronization [req-e8e83385-3ca3-4c37-b3eb-eab10385db05 req-0640b0ff-82a9-4663-945a-1eb5920ccafa tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1070.115834] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1070.116651] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.119659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.119659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.119659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.119659] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.119659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.119659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.119659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.119659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.119659] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.621800] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.622155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.622155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.622269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.622361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.622552] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.622652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.622715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.622863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.622939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.623037] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 1070.654529] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.654529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.654529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.654529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.654529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.661125] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 1071.170414] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1071.170640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.170802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.171164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.171255] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.171383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.171451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.171617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.171699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.171784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.171878] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.674692] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.675039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.675039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.675158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.675344] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.675444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.675510] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.675656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.675742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.675829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.675992] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.676096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.676158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.676297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.676562] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.676716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.676777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.676943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.677028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.677126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.677230] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.121119] env[69777]: INFO networking_nsxv3.common.synchronization [None req-1c78a6ef-5277-45ed-a115-57dbb0d56276 None None] Enqueued Resource ID: 8e5427b8-b646-424c-b4d4-f18a06fd1f90 with Priority: HIGHEST for action port [ 1072.121816] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5427b8-b646-424c-b4d4-f18a06fd1f90 with Priority: HIGHEST for action port [ 1072.122204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e5427b8-b646-424c-b4d4-f18a06fd1f90 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.122375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e5427b8-b646-424c-b4d4-f18a06fd1f90" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.122466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e5427b8-b646-424c-b4d4-f18a06fd1f90" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.122752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e5427b8-b646-424c-b4d4-f18a06fd1f90" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.122915] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e5427b8-b646-424c-b4d4-f18a06fd1f90',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.180023] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06bee688-2b64-4a9b-b0eb-ee4c735a9c41: rpc.has_security_group_logging(os_id): False [ 1072.210705] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.210976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.210976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.211323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.211323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.211621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.211760] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.211821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.211963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.212043] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.212300] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.212400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.212463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.212599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.212674] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.212853] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.212941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.213364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.213364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.213364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.213364] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1072.292144] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.292317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.292453] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.292588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.292735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.311421] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1072.625847] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e5427b8-b646-424c-b4d4-f18a06fd1f90 [ 1072.625847] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.625847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.625847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.626201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.626201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.626270] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e5427b8-b646-424c-b4d4-f18a06fd1f90 already deleted. [ 1072.626337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e5427b8-b646-424c-b4d4-f18a06fd1f90" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.673875] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 1072.673875] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 deletion is rescheduled due to dependency. [ 1072.673875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.803188] env[69777]: INFO networking_nsxv3.common.synchronization [None req-ac2632e9-f0bd-4802-8551-07ff97161d88 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_rules [ 1072.803713] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_rules [ 1072.805264] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50bad828-a4cc-463b-9c54-306ad5358f8d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.805264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.805264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.805264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.805264] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.945858] env[69777]: INFO networking_nsxv3.common.synchronization [None req-2f2559ec-883f-41d5-bbf7-685e7c4b94b2 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_rules [ 1072.946892] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_rules [ 1072.946892] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50bad828-a4cc-463b-9c54-306ad5358f8d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.946892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.324162] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.324309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.324377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.324590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.324680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.325056] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50bad828-a4cc-463b-9c54-306ad5358f8d already deleted. [ 1073.325056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.325056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.325197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.325269] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.846362] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.846362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.846362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.846362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.846362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.846362] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50bad828-a4cc-463b-9c54-306ad5358f8d already deleted. [ 1073.846362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.922550] env[69777]: INFO networking_nsxv3.common.synchronization [None req-53cc8bac-cd0a-4b4e-9409-6852ba83076f tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_rules [ 1073.924440] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_rules [ 1073.929209] env[69777]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1073.929209] env[69777]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] NSXv3 Agent Agent loop - iteration:2 started [ 1073.929622] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7b1a811-2cde-4056-af4d-31f7ea781dba taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.929711] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.929793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.933913] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.933913] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.057691] env[69777]: INFO networking_nsxv3.common.synchronization [None req-695163ee-d678-40b7-8f3c-df7bd8781748 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_rules [ 1074.058329] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_rules [ 1074.058668] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7b1a811-2cde-4056-af4d-31f7ea781dba taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.058774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.326991] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1074.327261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.435446] env[69777]: INFO networking_nsxv3.common.synchronization [None req-4c07aad6-c5d4-49c4-af03-2a0f036b8603 None None] Enqueued Resource ID: 3721e8e4-33f9-43a0-a412-0e734877c046 with Priority: HIGHEST for action port [ 1074.435984] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3721e8e4-33f9-43a0-a412-0e734877c046 with Priority: HIGHEST for action port [ 1074.436916] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-3721e8e4-33f9-43a0-a412-0e734877c046 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.436916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3721e8e4-33f9-43a0-a412-0e734877c046" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.437124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3721e8e4-33f9-43a0-a412-0e734877c046" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.437246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3721e8e4-33f9-43a0-a412-0e734877c046" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.437341] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3721e8e4-33f9-43a0-a412-0e734877c046',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.452223] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.452603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.452603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.452990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.452990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.452990] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7b1a811-2cde-4056-af4d-31f7ea781dba already deleted. [ 1074.452990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.453685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.453685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.453792] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.940200] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3721e8e4-33f9-43a0-a412-0e734877c046 [ 1074.940507] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.940649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.940649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.941029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.941029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.941029] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3721e8e4-33f9-43a0-a412-0e734877c046 already deleted. [ 1074.941175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3721e8e4-33f9-43a0-a412-0e734877c046" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.972670] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.972806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.972903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.973096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.973186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.973284] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7b1a811-2cde-4056-af4d-31f7ea781dba already deleted. [ 1074.973367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.013199] env[69777]: INFO networking_nsxv3.common.synchronization [req-fad8b035-8c92-48d0-b7eb-15ce42208a07 req-6b35a8e2-3855-4ea6-bd15-d2175d0a169f tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1077.013738] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1077.014055] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.014181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.014241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.014435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.015331] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.015331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.015331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.015331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.015331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.015331] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.086996] env[69777]: INFO networking_nsxv3.common.synchronization [req-447e2dd3-dbf3-4fa4-9139-3bc1d1cf000a req-9b6b9b76-cbd1-44ce-b3b9-2dd88762c36e tempest-ServerRescueNegativeTestJSON-1534204294 tempest-ServerRescueNegativeTestJSON-1534204294-project-member] Enqueued Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 1077.091030] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 1077.091030] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.091030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.091030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.091030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.091030] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.091030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.091030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.091030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.091030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.091030] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.517218] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.593106] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.020866] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.037747] env[69777]: INFO networking_nsxv3.common.synchronization [req-265bdd00-5e81-4826-bf65-f260efb07b9e req-a6e6df8c-0c37-4910-9b3d-8549023e07cc tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_members [ 1078.037858] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_members [ 1078.038098] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f64a4b87-9b99-4306-97e4-e97d2b7d7388 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.038469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.038469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.038634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.038682] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.038762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.038819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.038967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.039203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.039309] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.086461] env[69777]: INFO networking_nsxv3.common.synchronization [req-bde1e24e-bf08-4be6-83c0-9e1caf9c5f30 req-9a612f6f-492b-4ca0-b2cf-0bc333fb65ab tempest-ImagesTestJSON-42450789 tempest-ImagesTestJSON-42450789-project-member] Enqueued Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 1078.087544] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31a3d66-3f9b-4509-bdc2-763f23333743 with Priority: HIGHEST for action security_group_members [ 1078.088315] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c31a3d66-3f9b-4509-bdc2-763f23333743 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.088448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.088734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.088960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.089136] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.089236] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.089303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.089457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.089591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.091150] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c31a3d66-3f9b-4509-bdc2-763f23333743',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.094800] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.408745] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.408957] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.409101] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.409379] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.409662] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.409844] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.409977] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.410209] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.410359] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.410594] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.410685] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.410797] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.410925] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.411036] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.411146] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.411281] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.430743] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.430919] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1078.431102] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.431335] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.431655] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-6315fbc5-ee43-4446-afd6-de006ad55b9a taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.431831] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-6315fbc5-ee43-4446-afd6-de006ad55b9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.431951] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-6315fbc5-ee43-4446-afd6-de006ad55b9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.432351] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-6315fbc5-ee43-4446-afd6-de006ad55b9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.432511] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6315fbc5-ee43-4446-afd6-de006ad55b9a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.524204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.524204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.524204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.524204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.524204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.524204] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1078.541318] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.541494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.541564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.541747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.541834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.542039] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.542129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.542182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.542323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.542395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.542478] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 already deleted. [ 1078.542552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.555493] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.555632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.555716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.555854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.555991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.566127] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1078.593843] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.593843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.593843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.593843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.593843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.594181] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.594181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.594181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.594767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.594767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.594767] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 is going to be updated. [ 1078.596084] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.596208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.596273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.596424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.596555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.596614] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 is going to be updated. [ 1078.624880] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.624880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.624986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.626037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.626037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.627028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.627144] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.627144] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.627310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.627430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.639295] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: IN_PROGRESS for 2s [ 1078.640097] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: IN_PROGRESS for 2s [ 1078.937059] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.937059] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.937236] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.937402] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.937553] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.937705] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 6315fbc5-ee43-4446-afd6-de006ad55b9a not found, creating... [ 1078.937978] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.938161] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.938282] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.938496] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.938637] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.938920] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.939093] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.939214] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.939419] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.939555] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.939693] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 6315fbc5-ee43-4446-afd6-de006ad55b9a is going to be created. [ 1078.959323] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.959498] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.959624] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.959843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.960108] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.960339] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-6315fbc5-ee43-4446-afd6-de006ad55b9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.921009] env[69777]: INFO networking_nsxv3.common.synchronization [req-265bdd00-5e81-4826-bf65-f260efb07b9e req-1ebdc3e3-8d51-4f21-acff-c6e75ae8ed9c service nova] Enqueued Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_rules [ 1079.921300] env[69777]: INFO networking_nsxv3.common.synchronization [req-265bdd00-5e81-4826-bf65-f260efb07b9e req-1ebdc3e3-8d51-4f21-acff-c6e75ae8ed9c service nova] Enqueued Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_members [ 1079.921333] env[69777]: INFO networking_nsxv3.common.synchronization [req-265bdd00-5e81-4826-bf65-f260efb07b9e req-1ebdc3e3-8d51-4f21-acff-c6e75ae8ed9c service nova] Enqueued Resource ID: 6315fbc5-ee43-4446-afd6-de006ad55b9a with Priority: HIGHEST for action port [ 1079.921560] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_rules [ 1079.921688] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_members [ 1079.921799] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6315fbc5-ee43-4446-afd6-de006ad55b9a with Priority: HIGHEST for action port [ 1079.922319] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.922443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.922506] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.922703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.922792] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.924049] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f64a4b87-9b99-4306-97e4-e97d2b7d7388 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.924195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.924288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.924494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.924667] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.924801] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.924865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.925092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.925159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.925254] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.926102] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-6315fbc5-ee43-4446-afd6-de006ad55b9a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.926191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6315fbc5-ee43-4446-afd6-de006ad55b9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.926243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6315fbc5-ee43-4446-afd6-de006ad55b9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.926380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6315fbc5-ee43-4446-afd6-de006ad55b9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.926629] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6315fbc5-ee43-4446-afd6-de006ad55b9a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.428645] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.429972] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f64a4b87-9b99-4306-97e4-e97d2b7d7388 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.430091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.430257] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6315fbc5-ee43-4446-afd6-de006ad55b9a with status ACTIVE [ 1080.430414] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.430624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.430624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.430774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.430855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.431075] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.431181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.431241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.431426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.431493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.431741] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.431741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.431958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.431958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.432095] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.432095] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6315fbc5-ee43-4446-afd6-de006ad55b9a is going to be updated. [ 1080.454320] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.454320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.454320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.454320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.454320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.454320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6315fbc5-ee43-4446-afd6-de006ad55b9a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.586428] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1080.586843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.634776] env[69777]: INFO networking_nsxv3.common.synchronization [req-cfe8fd50-7c18-4c5e-9b86-c65ae8edd1d8 req-9c748106-4612-4450-a600-8b4f01680a27 tempest-TenantUsagesTestJSON-1632990832 tempest-TenantUsagesTestJSON-1632990832-project-member] Enqueued Resource ID: fff25930-cb45-4041-b401-1bef6155831b with Priority: HIGHEST for action security_group_members [ 1080.634945] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff25930-cb45-4041-b401-1bef6155831b with Priority: HIGHEST for action security_group_members [ 1080.635299] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff25930-cb45-4041-b401-1bef6155831b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.635468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.635569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.636271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.636967] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.636967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.636967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.636967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.636967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.636967] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fff25930-cb45-4041-b401-1bef6155831b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.649472] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c31a3d66-3f9b-4509-bdc2-763f23333743 in Status: SUCCESS [ 1080.649639] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c31a3d66-3f9b-4509-bdc2-763f23333743 deletion is rescheduled due to dependency. [ 1080.649744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c31a3d66-3f9b-4509-bdc2-763f23333743" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.650481] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: SUCCESS [ 1080.650640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.934192] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.998828] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.999047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.999181] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.999451] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.999719] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.999949] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.000248] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.000547] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.000745] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.001141] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.001141] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.001312] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.001456] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.001603] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.001741] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.001912] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.021047] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.021239] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1081.021384] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.021555] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-977" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.021864] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.022069] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.022211] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.022518] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.022658] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.141867] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.142037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.142104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.142317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.142413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.142596] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.142695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.142758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.142892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.142963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.143064] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff25930-cb45-4041-b401-1bef6155831b already deleted. [ 1081.143145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.439900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.440191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.440269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.440473] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.440563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.440666] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 is going to be created. [ 1081.465409] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.465576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.465620] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.465807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.465961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.474297] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 in Status: UNINITIALIZED for 2s [ 1081.528468] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.528468] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.528468] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.528468] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.528637] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.528683] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96 not found, creating... [ 1081.528958] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.529130] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.529253] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.529464] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.529616] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.530032] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.530230] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.530355] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.530565] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.530729] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.530873] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96 is going to be created. [ 1081.550034] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.550253] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.550383] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.550637] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.550862] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.551106] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.284448] env[69777]: INFO networking_nsxv3.common.synchronization [req-cfe8fd50-7c18-4c5e-9b86-c65ae8edd1d8 req-fdb21a24-e548-47a1-ac21-2f14c327026b service nova] Enqueued Resource ID: fff25930-cb45-4041-b401-1bef6155831b with Priority: HIGHEST for action security_group_rules [ 1082.284819] env[69777]: INFO networking_nsxv3.common.synchronization [req-cfe8fd50-7c18-4c5e-9b86-c65ae8edd1d8 req-fdb21a24-e548-47a1-ac21-2f14c327026b service nova] Enqueued Resource ID: fff25930-cb45-4041-b401-1bef6155831b with Priority: HIGHEST for action security_group_members [ 1082.284819] env[69777]: INFO networking_nsxv3.common.synchronization [req-cfe8fd50-7c18-4c5e-9b86-c65ae8edd1d8 req-fdb21a24-e548-47a1-ac21-2f14c327026b service nova] Enqueued Resource ID: 8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96 with Priority: HIGHEST for action port [ 1082.285134] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff25930-cb45-4041-b401-1bef6155831b with Priority: HIGHEST for action security_group_rules [ 1082.285134] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff25930-cb45-4041-b401-1bef6155831b with Priority: HIGHEST for action security_group_members [ 1082.285134] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96 with Priority: HIGHEST for action port [ 1082.285664] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fff25930-cb45-4041-b401-1bef6155831b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.285920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.285920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.286076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.286162] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fff25930-cb45-4041-b401-1bef6155831b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.287358] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff25930-cb45-4041-b401-1bef6155831b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.287497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.287583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.287712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.287886] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.288432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.288432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.288432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.288432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.288432] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fff25930-cb45-4041-b401-1bef6155831b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.289078] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.289196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.289290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.289381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.289461] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.790972] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fff25930-cb45-4041-b401-1bef6155831b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.792067] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff25930-cb45-4041-b401-1bef6155831b taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.792168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.792335] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96 with status ACTIVE [ 1082.792477] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.792581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.792642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.792835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.792916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.793111] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.793873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.793873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.793873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.793873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.793873] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.793873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.793873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.794195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.794195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.794195] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96 is going to be updated. [ 1082.817135] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.817291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.817366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.817549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.817681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.817899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ece4d94-f4f1-46aa-92f0-2b24ed4bfc96" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.025961] env[69777]: INFO networking_nsxv3.common.synchronization [req-912d08d5-1728-4e77-89fb-94e49aa1d215 req-06b411ef-0733-4977-aab6-2ba68580a9f5 tempest-InstanceActionsNegativeTestJSON-916189138 tempest-InstanceActionsNegativeTestJSON-916189138-project-member] Enqueued Resource ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 with Priority: HIGHEST for action security_group_members [ 1083.026514] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 with Priority: HIGHEST for action security_group_members [ 1083.027377] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb5e9a12-ae77-432f-9642-7c6f122d8264 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.027377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.027377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.031335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.031575] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.031669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.031669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.031834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.031913] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.032019] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb5e9a12-ae77-432f-9642-7c6f122d8264',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.299919] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fff25930-cb45-4041-b401-1bef6155831b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.388408] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.388635] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-257" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.388737] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-257" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.389081] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-257" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.389359] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.389522] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.389644] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.389867] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.390074] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.390315] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.390437] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.390550] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.390661] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.390773] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1083.390882] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.391062] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.422837] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.423013] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1083.423264] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.423451] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-257" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.423755] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-f2c57ce2-0644-40ac-a5e2-a5b0a1114e10 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.423927] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-f2c57ce2-0644-40ac-a5e2-a5b0a1114e10" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.424064] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-f2c57ce2-0644-40ac-a5e2-a5b0a1114e10" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.426784] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-f2c57ce2-0644-40ac-a5e2-a5b0a1114e10" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.426784] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c57ce2-0644-40ac-a5e2-a5b0a1114e10',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.488928] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 in Status: SUCCESS [ 1083.489172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.489595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.489595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.489735] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.489829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.489891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.490062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.490233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.490338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.490429] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.535966] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.535966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.535966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.536183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.536221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.536416] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.536514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.536577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.536727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.536803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.536892] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 already deleted. [ 1083.536972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.805951] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.806182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.806292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.806558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.806676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.806826] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff25930-cb45-4041-b401-1bef6155831b is going to be created. [ 1083.832227] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.832404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.832526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.832738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.832941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.841398] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff25930-cb45-4041-b401-1bef6155831b in Status: UNINITIALIZED for 2s [ 1083.926858] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.927149] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.927268] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.927564] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.927776] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.928014] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port f2c57ce2-0644-40ac-a5e2-a5b0a1114e10 not found, creating... [ 1083.928375] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.928549] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.928676] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.928933] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.929102] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.929399] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.929592] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.929729] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.930054] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.930316] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.930472] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: f2c57ce2-0644-40ac-a5e2-a5b0a1114e10 is going to be created. [ 1083.955627] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.955893] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.956090] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.956439] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.956734] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.957029] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-f2c57ce2-0644-40ac-a5e2-a5b0a1114e10" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.992769] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.495721] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f64a4b87-9b99-4306-97e4-e97d2b7d7388: rpc.has_security_group_logging(os_id): False [ 1084.514443] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.518412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.518412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.518611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.518701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.519344] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.519344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.519344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.519344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.519557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.519557] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 is going to be created. [ 1084.576405] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.576556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.576627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.576839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.577028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.587223] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 in Status: IN_PROGRESS for 2s [ 1084.713017] env[69777]: INFO networking_nsxv3.common.synchronization [req-912d08d5-1728-4e77-89fb-94e49aa1d215 req-6f283fc7-06db-4518-8b0f-31b3e1057db6 service nova] Enqueued Resource ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 with Priority: HIGHEST for action security_group_rules [ 1084.713017] env[69777]: INFO networking_nsxv3.common.synchronization [req-912d08d5-1728-4e77-89fb-94e49aa1d215 req-6f283fc7-06db-4518-8b0f-31b3e1057db6 service nova] Enqueued Resource ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 with Priority: HIGHEST for action security_group_members [ 1084.713017] env[69777]: INFO networking_nsxv3.common.synchronization [req-912d08d5-1728-4e77-89fb-94e49aa1d215 req-6f283fc7-06db-4518-8b0f-31b3e1057db6 service nova] Enqueued Resource ID: f2c57ce2-0644-40ac-a5e2-a5b0a1114e10 with Priority: HIGHEST for action port [ 1084.713017] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 with Priority: HIGHEST for action security_group_rules [ 1084.713017] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 with Priority: HIGHEST for action security_group_members [ 1084.713017] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2c57ce2-0644-40ac-a5e2-a5b0a1114e10 with Priority: HIGHEST for action port [ 1084.713491] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb5e9a12-ae77-432f-9642-7c6f122d8264 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.713491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.713491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.713670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.713749] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb5e9a12-ae77-432f-9642-7c6f122d8264',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.718711] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb5e9a12-ae77-432f-9642-7c6f122d8264 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.718864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.718937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.719134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.719314] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.719388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.719445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.720200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.720200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.720200] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb5e9a12-ae77-432f-9642-7c6f122d8264',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.720586] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2c57ce2-0644-40ac-a5e2-a5b0a1114e10 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.720586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2c57ce2-0644-40ac-a5e2-a5b0a1114e10" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.720803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2c57ce2-0644-40ac-a5e2-a5b0a1114e10" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.720803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2c57ce2-0644-40ac-a5e2-a5b0a1114e10" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.720903] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c57ce2-0644-40ac-a5e2-a5b0a1114e10',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.223839] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb5e9a12-ae77-432f-9642-7c6f122d8264 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.223839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.223839] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb5e9a12-ae77-432f-9642-7c6f122d8264',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.224205] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2c57ce2-0644-40ac-a5e2-a5b0a1114e10 with status ACTIVE [ 1085.224384] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.224515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.224588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.224905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.225016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.225246] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.225434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.225434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.226023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.226023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.226023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.226023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.226892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.227011] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.227121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.228921] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2c57ce2-0644-40ac-a5e2-a5b0a1114e10 is going to be updated. [ 1085.249119] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.249305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.249349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.249567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.249720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.249884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2c57ce2-0644-40ac-a5e2-a5b0a1114e10" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.729092] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb5e9a12-ae77-432f-9642-7c6f122d8264',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.853274] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff25930-cb45-4041-b401-1bef6155831b in Status: SUCCESS [ 1085.856034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.856034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.856034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.856234] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.856234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.856360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.856434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.856511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.857396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.857396] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fff25930-cb45-4041-b401-1bef6155831b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.231424] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.231596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.231660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.231899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.231991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.232108] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 is going to be created. [ 1086.254856] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.254927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.254966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.255566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.255566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.264277] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 in Status: UNINITIALIZED for 2s [ 1086.359306] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff25930-cb45-4041-b401-1bef6155831b taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.359563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.359693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.359929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.360668] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.360668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.360668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.360668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.361135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.361135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.361273] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff25930-cb45-4041-b401-1bef6155831b taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.361336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.361501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.361668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.361866] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.362046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.362153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.362356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.362449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.362571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.362715] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fff25930-cb45-4041-b401-1bef6155831b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.601243] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 in Status: SUCCESS [ 1086.601243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.865664] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fff25930-cb45-4041-b401-1bef6155831b: rpc.has_security_group_logging(os_id): False [ 1086.884904] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.885223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.885315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.885502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.885631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.885798] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.885894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.885957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.886115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.886192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.886379] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.887176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.887176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.887176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.887176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.887176] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.887176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.887176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.887595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.887689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.887999] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fff25930-cb45-4041-b401-1bef6155831b is going to be created. [ 1086.943749] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.943892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.943985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.944217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.944398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.957106] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fff25930-cb45-4041-b401-1bef6155831b in Status: IN_PROGRESS for 2s [ 1087.787658] env[69777]: INFO networking_nsxv3.common.synchronization [req-5fcf1174-2bcb-408c-9a78-f15f9ec6d9a4 req-464afc38-fdc8-4a9e-b85d-c2faa97dd67e tempest-ListServersNegativeTestJSON-690575533 tempest-ListServersNegativeTestJSON-690575533-project-member] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1087.787658] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1087.790280] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.790382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.790474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.791022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.791022] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.791022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.791022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.791285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.791285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.791921] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.795034] env[69777]: INFO networking_nsxv3.common.synchronization [req-8f7f5796-8755-4150-bfc5-c34db9be1412 req-787451fc-b064-4f53-aaeb-f61927a81bd0 tempest-ListServersNegativeTestJSON-690575533 tempest-ListServersNegativeTestJSON-690575533-project-member] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1087.795034] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGHEST for action security_group_members [ 1087.795426] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.795426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.274175] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 in Status: SUCCESS [ 1088.274459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.274704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.274983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.275259] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.275455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.275631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.275858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.275989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.276142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.276274] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb5e9a12-ae77-432f-9642-7c6f122d8264',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.293860] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.294039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.294086] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.294277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.294362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.294547] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.294644] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.294707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.294849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.294924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.295029] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be updated. [ 1088.334117] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.334312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.334369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.334561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.334699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.343786] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: IN_PROGRESS for 2s [ 1088.782450] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb5e9a12-ae77-432f-9642-7c6f122d8264 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.782450] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.782450] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb5e9a12-ae77-432f-9642-7c6f122d8264 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.782450] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.782450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.783112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.783112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.783112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.783112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.783112] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb5e9a12-ae77-432f-9642-7c6f122d8264',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.968912] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fff25930-cb45-4041-b401-1bef6155831b in Status: SUCCESS [ 1088.968912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.285204] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb5e9a12-ae77-432f-9642-7c6f122d8264: rpc.has_security_group_logging(os_id): False [ 1089.303528] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.303736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.303736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.303963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.304065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.304265] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.304401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.304401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.304565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.304639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.304826] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.304966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.305045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.305195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.305301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.305515] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.305791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.305875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.306022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.306099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.306192] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 is going to be created. [ 1089.360777] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.361091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.361180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.361401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.361828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.372067] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 in Status: IN_PROGRESS for 2s [ 1090.353206] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1090.353546] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c deletion is rescheduled due to dependency. [ 1090.353546] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.353658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.354633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.354633] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.354633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.354633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.354633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.354633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.355176] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.860062] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.860062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.860062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.860062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.860062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.860062] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.860062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.860062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.860062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.860062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.860062] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be updated. [ 1090.882758] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.882915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.882915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.883274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.883366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.892460] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: IN_PROGRESS for 2s [ 1091.384910] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 in Status: SUCCESS [ 1091.386057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.806681] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a19966c-fa19-4736-86df-964aafae1df6 req-8a9f8560-6412-4f6c-a98a-1210522b22e0 tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1091.807288] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1091.807593] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.807716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.807783] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.807983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.808143] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.808244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.808305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.808451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.808533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.808621] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.100524] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.100721] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.101088] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.101173] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.101436] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.101589] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.101706] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.101924] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.102079] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.102283] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.102462] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.102507] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.102601] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.102706] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.102808] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.102934] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.123056] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.123056] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1092.123056] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.123056] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.123056] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-6a847b86-dfc5-4e54-a423-c38995fe8898 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.123056] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-6a847b86-dfc5-4e54-a423-c38995fe8898" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.123056] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-6a847b86-dfc5-4e54-a423-c38995fe8898" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.123056] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-6a847b86-dfc5-4e54-a423-c38995fe8898" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.123056] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a847b86-dfc5-4e54-a423-c38995fe8898',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.311407] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.311569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.311631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.311851] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.311978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.312145] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.312252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.312295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.312445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.312520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.312612] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1092.339493] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.339641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.339715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.339920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.340128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.349930] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1092.625846] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.626174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.626174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.626295] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.626460] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.626619] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 6a847b86-dfc5-4e54-a423-c38995fe8898 not found, creating... [ 1092.626870] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.627037] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.627167] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.627384] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.627527] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.627821] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.627983] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.628161] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.628390] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.628533] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.628677] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 6a847b86-dfc5-4e54-a423-c38995fe8898 is going to be created. [ 1092.648639] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.648814] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.648922] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.649189] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.649418] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.649632] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-6a847b86-dfc5-4e54-a423-c38995fe8898" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.902465] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54f2e457-46a8-40bd-9513-a556b213a51c in Status: SUCCESS [ 1092.902465] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c deletion is rescheduled due to dependency. [ 1092.902465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.413877] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a19966c-fa19-4736-86df-964aafae1df6 req-4f74ca6c-5d53-4e48-a5d4-46429a698d2d service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 1093.414084] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a19966c-fa19-4736-86df-964aafae1df6 req-4f74ca6c-5d53-4e48-a5d4-46429a698d2d service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1093.414203] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a19966c-fa19-4736-86df-964aafae1df6 req-4f74ca6c-5d53-4e48-a5d4-46429a698d2d service nova] Enqueued Resource ID: 6a847b86-dfc5-4e54-a423-c38995fe8898 with Priority: HIGHEST for action port [ 1093.414420] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 1093.414550] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1093.414647] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a847b86-dfc5-4e54-a423-c38995fe8898 with Priority: HIGHEST for action port [ 1093.415212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.415362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.415582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.415790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.415872] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.416681] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.416983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.417508] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a847b86-dfc5-4e54-a423-c38995fe8898 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.417619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a847b86-dfc5-4e54-a423-c38995fe8898" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.417685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a847b86-dfc5-4e54-a423-c38995fe8898" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.417847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a847b86-dfc5-4e54-a423-c38995fe8898" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.417964] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a847b86-dfc5-4e54-a423-c38995fe8898',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.919559] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.919862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.919862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a847b86-dfc5-4e54-a423-c38995fe8898 with status ACTIVE [ 1093.919942] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.920143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.920201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.920375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.920462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.920667] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.920770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.920834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.920981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.921163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.921323] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.921416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.921469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.922032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.922032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.922032] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a847b86-dfc5-4e54-a423-c38995fe8898 is going to be updated. [ 1093.948324] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.948542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.948542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.948731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.948862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.949028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a847b86-dfc5-4e54-a423-c38995fe8898" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.221212] env[69777]: INFO networking_nsxv3.common.synchronization [req-d1070e6b-a304-420b-9fd9-8193c8af18b6 req-2f993e2a-c94b-45ac-b3f2-b0b472c93dbe tempest-ServerMetadataNegativeTestJSON-2024737415 tempest-ServerMetadataNegativeTestJSON-2024737415-project-member] Enqueued Resource ID: 934508a6-471e-40c3-b26e-4595587a983c with Priority: HIGHEST for action security_group_members [ 1094.221778] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934508a6-471e-40c3-b26e-4595587a983c with Priority: HIGHEST for action security_group_members [ 1094.222102] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-934508a6-471e-40c3-b26e-4595587a983c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.222232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.222302] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.223163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.223163] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.223163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.223163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.223163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.223163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.223163] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934508a6-471e-40c3-b26e-4595587a983c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.360241] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1094.361106] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 1094.361106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.361106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.361106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.361106] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.361336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.361336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.361490] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.361607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.361725] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.591132] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-147 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.591132] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-147" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.591132] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-147" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.591132] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-147" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.591132] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.591132] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.591132] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.591132] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.591132] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.591920] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1094.592237] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.592502] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.592749] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.592991] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1094.593259] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.593596] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.614029] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.614029] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1094.614029] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.614029] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-147" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.614029] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-1325d38b-920f-46c8-96d6-997f4f4001c2 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.614029] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-1325d38b-920f-46c8-96d6-997f4f4001c2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.614029] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-1325d38b-920f-46c8-96d6-997f4f4001c2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.614029] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-1325d38b-920f-46c8-96d6-997f4f4001c2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.614029] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1325d38b-920f-46c8-96d6-997f4f4001c2',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.727803] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.728216] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.728383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.728538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.728640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.728865] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.728977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.731725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.731725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.731725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.731725] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934508a6-471e-40c3-b26e-4595587a983c already deleted. [ 1094.731725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.864169] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.119280] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.119280] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.119280] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.119280] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.119280] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.119280] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 1325d38b-920f-46c8-96d6-997f4f4001c2 not found, creating... [ 1095.119280] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.119280] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.119280] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.121881] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.123365] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.126506] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.126506] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.126506] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.126506] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.126506] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.126506] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 1325d38b-920f-46c8-96d6-997f4f4001c2 is going to be created. [ 1095.144101] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.144725] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.145070] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.145517] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.145901] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.146596] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-1325d38b-920f-46c8-96d6-997f4f4001c2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.299778] env[69777]: INFO networking_nsxv3.common.synchronization [req-4f865887-c291-47a3-bc15-9ffcfe88dd15 req-6ad5f4f6-fbd8-4734-b1b6-c63d6cc72ff7 tempest-TenantUsagesTestJSON-1632990832 tempest-TenantUsagesTestJSON-1632990832-project-member] Enqueued Resource ID: fff25930-cb45-4041-b401-1bef6155831b with Priority: HIGHEST for action security_group_members [ 1095.300511] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff25930-cb45-4041-b401-1bef6155831b with Priority: HIGHEST for action security_group_members [ 1095.300934] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff25930-cb45-4041-b401-1bef6155831b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.302299] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.302439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.302787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.304460] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.304460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.304667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.304755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.304904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.305067] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fff25930-cb45-4041-b401-1bef6155831b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.366119] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.548962] env[69777]: INFO networking_nsxv3.common.synchronization [req-e5ae646f-b86a-4b4d-9cc3-4dd4e29f2722 req-cea1d31b-245d-431b-a96e-82e0945ab131 tempest-InstanceActionsNegativeTestJSON-916189138 tempest-InstanceActionsNegativeTestJSON-916189138-project-member] Enqueued Resource ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 with Priority: HIGHEST for action security_group_members [ 1095.549509] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 with Priority: HIGHEST for action security_group_members [ 1095.549801] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb5e9a12-ae77-432f-9642-7c6f122d8264 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.549917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.549982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.550224] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.550384] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.550486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.550545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.550696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.550780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.551194] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb5e9a12-ae77-432f-9642-7c6f122d8264',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.807256] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.807829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.807829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.807829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.807829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.808026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.808102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.808140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.808270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.808345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.808434] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff25930-cb45-4041-b401-1bef6155831b is going to be updated. [ 1095.833571] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.833738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.833738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.833950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.834129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.842157] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff25930-cb45-4041-b401-1bef6155831b in Status: IN_PROGRESS for 2s [ 1095.870872] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.870872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.870872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.870872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.870872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.870872] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1095.895967] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.896377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.896502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.897243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.897243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.905157] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1095.912740] env[69777]: INFO networking_nsxv3.common.synchronization [req-d1070e6b-a304-420b-9fd9-8193c8af18b6 req-c1c5eeac-a89b-4979-b8d5-3dc64a4bbe45 service nova] Enqueued Resource ID: 934508a6-471e-40c3-b26e-4595587a983c with Priority: HIGHEST for action security_group_rules [ 1095.912904] env[69777]: INFO networking_nsxv3.common.synchronization [req-d1070e6b-a304-420b-9fd9-8193c8af18b6 req-c1c5eeac-a89b-4979-b8d5-3dc64a4bbe45 service nova] Enqueued Resource ID: 934508a6-471e-40c3-b26e-4595587a983c with Priority: HIGHEST for action security_group_members [ 1095.913069] env[69777]: INFO networking_nsxv3.common.synchronization [req-d1070e6b-a304-420b-9fd9-8193c8af18b6 req-c1c5eeac-a89b-4979-b8d5-3dc64a4bbe45 service nova] Enqueued Resource ID: 1325d38b-920f-46c8-96d6-997f4f4001c2 with Priority: HIGHEST for action port [ 1095.913320] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934508a6-471e-40c3-b26e-4595587a983c with Priority: HIGHEST for action security_group_rules [ 1095.913424] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934508a6-471e-40c3-b26e-4595587a983c with Priority: HIGHEST for action security_group_members [ 1095.913532] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1325d38b-920f-46c8-96d6-997f4f4001c2 with Priority: HIGHEST for action port [ 1095.917784] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-934508a6-471e-40c3-b26e-4595587a983c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.917910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.917977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.918329] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.918559] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('934508a6-471e-40c3-b26e-4595587a983c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.920165] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-934508a6-471e-40c3-b26e-4595587a983c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.920165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.920165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.920165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.920451] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.920451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.920451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.920616] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.920664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.920746] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934508a6-471e-40c3-b26e-4595587a983c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.921520] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1325d38b-920f-46c8-96d6-997f4f4001c2 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.921634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1325d38b-920f-46c8-96d6-997f4f4001c2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.921681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1325d38b-920f-46c8-96d6-997f4f4001c2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.921812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1325d38b-920f-46c8-96d6-997f4f4001c2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.921878] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1325d38b-920f-46c8-96d6-997f4f4001c2',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.054684] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.055208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.055208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.055208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.055336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.055425] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.055528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.055591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.055743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.055817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.055902] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 is going to be updated. [ 1096.083065] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.083065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.083065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.083283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.083283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.090666] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 in Status: IN_PROGRESS for 2s [ 1096.423535] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('934508a6-471e-40c3-b26e-4595587a983c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.425504] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-934508a6-471e-40c3-b26e-4595587a983c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.425504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.425504] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1325d38b-920f-46c8-96d6-997f4f4001c2 with status ACTIVE [ 1096.425504] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.425504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.425504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.425504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.425504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.425940] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.425940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.425940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.425940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.425940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.426134] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.426210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.426264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.426402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.426492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.426555] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1325d38b-920f-46c8-96d6-997f4f4001c2 is going to be updated. [ 1096.446256] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.446479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.446479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.446644] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.446884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.446974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1325d38b-920f-46c8-96d6-997f4f4001c2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.928552] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('934508a6-471e-40c3-b26e-4595587a983c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.431128] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.431447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.431447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.431593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.431653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.431774] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934508a6-471e-40c3-b26e-4595587a983c is going to be created. [ 1097.458212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.458367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.458447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.458655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.458828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.469183] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934508a6-471e-40c3-b26e-4595587a983c in Status: UNINITIALIZED for 2s [ 1097.851768] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff25930-cb45-4041-b401-1bef6155831b in Status: SUCCESS [ 1097.851967] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff25930-cb45-4041-b401-1bef6155831b deletion is rescheduled due to dependency. [ 1097.852096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.914106] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1097.914311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.914484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.914695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.914885] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.915011] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.915087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.915246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.915325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.915409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.915497] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.100730] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 in Status: SUCCESS [ 1098.100956] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 deletion is rescheduled due to dependency. [ 1098.101096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.418257] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.418557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.418891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.419211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.419325] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.419587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.419628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.419887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.420053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.420207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.420477] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.420608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.420702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.421167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.421167] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.421288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.421322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.421600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.421699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.421818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.422286] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.924615] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44fd483-f70f-4a69-967b-e48536b42565: rpc.has_security_group_logging(os_id): False [ 1098.944071] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.944242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.944323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.944547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.944638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.944860] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.944964] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.945041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.945221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.945297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.945534] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.945738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.945738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.945877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.946142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.946209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.946303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.946385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.946522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.946642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.946731] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1099.019981] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.020209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.020280] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.020492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.020615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.038753] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1099.201692] env[69777]: INFO networking_nsxv3.common.synchronization [req-843626d7-644e-4042-89ae-cb4beaa860f2 req-d4656388-6936-47c9-9a0d-691ef488d64e tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1099.202201] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1099.202674] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.202674] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.202816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.202935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.203100] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.203259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.203259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.203450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.203549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.203678] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.479391] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934508a6-471e-40c3-b26e-4595587a983c in Status: SUCCESS [ 1099.479727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.479934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.480230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.480426] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.480658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.480794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.481132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.481248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.481323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.481437] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('934508a6-471e-40c3-b26e-4595587a983c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.527468] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.527694] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-383" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.527970] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-383" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.528147] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-383" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.528430] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.528593] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.528713] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.528941] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.529105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.529321] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.529436] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.529547] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.529658] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.529770] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.529904] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.530014] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.546695] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.546855] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1099.546996] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.547196] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-383" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.547499] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-1be0afb3-e7d1-4434-a78b-d41978d1a70f taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.547675] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.547799] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.548142] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.548317] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be0afb3-e7d1-4434-a78b-d41978d1a70f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.705504] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.705655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.705722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.705944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.706068] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.706243] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.706344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.706407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.706552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.706627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.706713] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 already deleted. [ 1099.706791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.812782] env[69777]: INFO networking_nsxv3.common.synchronization [req-ca6f3209-4504-471b-8b28-d6e80d00b8aa req-36a48f38-5db0-4e00-a442-e0f06a86de69 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_members [ 1099.813436] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 with Priority: HIGHEST for action security_group_members [ 1099.813761] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf7f4ddc-ed21-4d94-8cea-71e39c933549 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.813890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.813959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.814177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.814327] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.815856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.815856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.815856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.815856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.815856] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf7f4ddc-ed21-4d94-8cea-71e39c933549',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.985383] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-934508a6-471e-40c3-b26e-4595587a983c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.985383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.985383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.985383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.985383] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.985383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.985383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.985383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.985383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.985383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.985383] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-934508a6-471e-40c3-b26e-4595587a983c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.985383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.985383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.986180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.986180] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.986180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.986180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.986180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.986180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.986180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.986180] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('934508a6-471e-40c3-b26e-4595587a983c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.050751] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.051053] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.051254] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.051570] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.051760] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.051957] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 1be0afb3-e7d1-4434-a78b-d41978d1a70f not found, creating... [ 1100.052248] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.052417] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.052536] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.052759] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.052902] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.053220] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.053385] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.053508] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.053720] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.053859] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.054008] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 1be0afb3-e7d1-4434-a78b-d41978d1a70f is going to be created. [ 1100.074066] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.074307] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.074437] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.074715] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.074952] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.075214] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.319388] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.319567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.319642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.319866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.319951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.320235] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.320339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.320403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.320552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.320628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.320714] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 is going to be updated. [ 1100.351446] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.351446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.351446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.351635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.351718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.360394] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 in Status: IN_PROGRESS for 2s [ 1100.489966] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 934508a6-471e-40c3-b26e-4595587a983c: rpc.has_security_group_logging(os_id): False [ 1100.508039] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.508039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.508039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.508316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.508414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.508615] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.508745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.508817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.508968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.509061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.509302] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.509363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.509391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.509511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.509579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.509765] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.509857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.509906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.510054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.510182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.510286] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 934508a6-471e-40c3-b26e-4595587a983c is going to be created. [ 1100.569711] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.569865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.569930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.570183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.570365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.580035] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934508a6-471e-40c3-b26e-4595587a983c in Status: IN_PROGRESS for 2s [ 1100.837475] env[69777]: INFO networking_nsxv3.common.synchronization [req-843626d7-644e-4042-89ae-cb4beaa860f2 req-7eb05004-7944-446a-9a01-e2b8edc121e3 service nova] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1100.837666] env[69777]: INFO networking_nsxv3.common.synchronization [req-843626d7-644e-4042-89ae-cb4beaa860f2 req-7eb05004-7944-446a-9a01-e2b8edc121e3 service nova] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1100.837797] env[69777]: INFO networking_nsxv3.common.synchronization [req-843626d7-644e-4042-89ae-cb4beaa860f2 req-7eb05004-7944-446a-9a01-e2b8edc121e3 service nova] Enqueued Resource ID: 1be0afb3-e7d1-4434-a78b-d41978d1a70f with Priority: HIGHEST for action port [ 1100.838394] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1100.838531] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1100.838644] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be0afb3-e7d1-4434-a78b-d41978d1a70f with Priority: HIGHEST for action port [ 1100.838909] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.839050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.839121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.839387] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.839495] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.840869] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.840869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.840986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.841147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.841302] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.841440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.841440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.841651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.841703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.841754] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.842705] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be0afb3-e7d1-4434-a78b-d41978d1a70f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.842898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.842927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.843141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.843244] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be0afb3-e7d1-4434-a78b-d41978d1a70f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.052237] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1101.052622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.346242] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.346720] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.346720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.346848] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1be0afb3-e7d1-4434-a78b-d41978d1a70f with status ACTIVE [ 1101.347017] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.347265] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.347343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.347553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.347647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.347812] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.347909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.347990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.348174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.348253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.348615] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.348615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.348615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.348713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.348780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.348862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1be0afb3-e7d1-4434-a78b-d41978d1a70f is going to be updated. [ 1101.369607] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.369728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.369728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.369890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.370034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.370220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.851087] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.353676] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.353940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.353940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.354145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.354236] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.354339] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be created. [ 1102.372920] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 in Status: SUCCESS [ 1102.373131] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf7f4ddc-ed21-4d94-8cea-71e39c933549 deletion is rescheduled due to dependency. [ 1102.373238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf7f4ddc-ed21-4d94-8cea-71e39c933549" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.378233] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.378381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.378434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.378626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.378776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.391702] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: UNINITIALIZED for 2s [ 1102.595711] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 934508a6-471e-40c3-b26e-4595587a983c in Status: SUCCESS [ 1102.595936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.400783] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1104.401241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.401367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.401591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.401840] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.401971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.402050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.402220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.402304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.402390] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.402499] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.905282] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.905464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.905549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.905771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.905984] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.906061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.906121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.906291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.906387] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.906477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.906637] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.906747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.906806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.906957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.907114] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.907228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.907265] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.907423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.907470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.907596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.907640] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.411166] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6831ceb6-9d33-4058-9454-2d8e13eb4e86: rpc.has_security_group_logging(os_id): False [ 1105.428294] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.428512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.428512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.428726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.428813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.429114] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.429172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.429200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.429326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.429399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.429568] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.429659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.429718] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.429852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.429924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.430118] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.430285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.430347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.430486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.430558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.430641] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be created. [ 1105.460325] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.460600] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.460735] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.461033] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.461422] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.461653] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.461835] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.462016] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.462200] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.462412] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.462551] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.462674] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.462787] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.462900] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.463013] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.463160] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.494440] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.494611] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1105.494753] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.494954] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-717" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.495258] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-f2675e22-1a2f-4fdc-a364-397cd259d5d7 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.495441] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.495560] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.495818] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.496027] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2675e22-1a2f-4fdc-a364-397cd259d5d7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.501361] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.501780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.501780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.501780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.501864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.516205] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1105.839258] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1105.839376] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1106.000405] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.000661] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.000823] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.001056] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.001250] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.001611] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.001781] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.002621] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.002621] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.002621] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.002621] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.002814] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.002814] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.003048] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.003626] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.003626] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: f2675e22-1a2f-4fdc-a364-397cd259d5d7 is going to be updated. [ 1106.023320] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.023571] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.023665] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.023947] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.024204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.024389] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.818947] env[69777]: INFO networking_nsxv3.common.synchronization [req-5d18712f-1e17-460d-96f7-fa69f27b5021 req-45df14f9-003c-4111-818b-3b8455052d3a service nova] Enqueued Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_rules [ 1106.819178] env[69777]: INFO networking_nsxv3.common.synchronization [req-5d18712f-1e17-460d-96f7-fa69f27b5021 req-45df14f9-003c-4111-818b-3b8455052d3a service nova] Enqueued Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 1106.819298] env[69777]: INFO networking_nsxv3.common.synchronization [req-5d18712f-1e17-460d-96f7-fa69f27b5021 req-45df14f9-003c-4111-818b-3b8455052d3a service nova] Enqueued Resource ID: f2675e22-1a2f-4fdc-a364-397cd259d5d7 with Priority: HIGHEST for action port [ 1106.819575] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_rules [ 1106.819676] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 1106.819757] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2675e22-1a2f-4fdc-a364-397cd259d5d7 with Priority: HIGHEST for action port [ 1106.820364] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.820495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.820565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.820754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.820836] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.822046] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.822169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.822238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.822864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.822864] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.822864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.822864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.823036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.823036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.823092] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.823862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2675e22-1a2f-4fdc-a364-397cd259d5d7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.823944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.823944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.824245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.824294] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2675e22-1a2f-4fdc-a364-397cd259d5d7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.327081] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.328110] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.328219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.328378] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2675e22-1a2f-4fdc-a364-397cd259d5d7 with status ACTIVE [ 1107.328533] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.328638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.328704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.328900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.328988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.329240] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.329334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.329403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.329560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.329635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.329810] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.329902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.329961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.330112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.330253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.330344] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2675e22-1a2f-4fdc-a364-397cd259d5d7 is going to be updated. [ 1107.356430] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.356430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.356430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.357641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.357641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.357641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2675e22-1a2f-4fdc-a364-397cd259d5d7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.528297] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1107.528458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.834146] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.336766] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.336960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.337041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.337243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.337336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.337439] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 is going to be updated. [ 1108.366325] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.366511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.366587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.366826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.366988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.376256] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: IN_PROGRESS for 2s [ 1108.379070] env[69777]: INFO networking_nsxv3.common.synchronization [req-b134b069-9f7e-4ac0-a52c-8b2980796d06 req-818c0d94-bec1-417f-8d77-db093a6f01ec tempest-ServerMetadataNegativeTestJSON-2024737415 tempest-ServerMetadataNegativeTestJSON-2024737415-project-member] Enqueued Resource ID: 934508a6-471e-40c3-b26e-4595587a983c with Priority: HIGHEST for action security_group_members [ 1108.379652] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934508a6-471e-40c3-b26e-4595587a983c with Priority: HIGHEST for action security_group_members [ 1108.380217] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-934508a6-471e-40c3-b26e-4595587a983c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.380322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.380422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.380589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.380752] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.381107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.381107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.381107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.381271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.381271] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('934508a6-471e-40c3-b26e-4595587a983c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.888649] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.889044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.889044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.889113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.889250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.889415] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.889512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.889576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.890300] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.890393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.890496] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934508a6-471e-40c3-b26e-4595587a983c is going to be updated. [ 1108.943825] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.943967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.944056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.944295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.944404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.953899] env[69777]: INFO networking_nsxv3.common.synchronization [req-d0eb47c8-774f-4663-9653-17f72fdd4c85 req-e417c5f0-b3d1-4048-b0d7-f98e30f53fd5 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_members [ 1108.954112] env[69777]: INFO networking_nsxv3.common.synchronization [req-d0eb47c8-774f-4663-9653-17f72fdd4c85 req-e417c5f0-b3d1-4048-b0d7-f98e30f53fd5 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1108.955056] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934508a6-471e-40c3-b26e-4595587a983c in Status: IN_PROGRESS for 2s [ 1108.955494] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_members [ 1108.955628] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1108.955996] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a246dbb9-bbe3-4f92-8823-3c958f77d63e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.957634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.957771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.958014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.958188] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.958297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.958363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.958524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.958605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.958702] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.959579] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.960087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.960166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.960350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.960497] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.960597] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.960665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.960797] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.960879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.960965] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.003024] env[69777]: INFO networking_nsxv3.common.synchronization [req-d0eb47c8-774f-4663-9653-17f72fdd4c85 req-e417c5f0-b3d1-4048-b0d7-f98e30f53fd5 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1109.003024] env[69777]: INFO networking_nsxv3.common.synchronization [req-d0eb47c8-774f-4663-9653-17f72fdd4c85 req-e417c5f0-b3d1-4048-b0d7-f98e30f53fd5 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1109.003024] env[69777]: INFO networking_nsxv3.common.synchronization [req-d0eb47c8-774f-4663-9653-17f72fdd4c85 req-e417c5f0-b3d1-4048-b0d7-f98e30f53fd5 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_rules [ 1109.003024] env[69777]: INFO networking_nsxv3.common.synchronization [req-d0eb47c8-774f-4663-9653-17f72fdd4c85 req-e417c5f0-b3d1-4048-b0d7-f98e30f53fd5 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_members [ 1109.003024] env[69777]: INFO networking_nsxv3.common.synchronization [req-d0eb47c8-774f-4663-9653-17f72fdd4c85 req-e417c5f0-b3d1-4048-b0d7-f98e30f53fd5 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 1be0afb3-e7d1-4434-a78b-d41978d1a70f with Priority: HIGHEST for action port [ 1109.003024] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1109.003024] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_rules [ 1109.003024] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be0afb3-e7d1-4434-a78b-d41978d1a70f with Priority: HIGHEST for action port [ 1109.003024] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1109.003024] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_members [ 1109.003024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.003024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.003024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.003024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.003894] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.004514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.004732] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.004732] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.009131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.009257] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.010323] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be0afb3-e7d1-4434-a78b-d41978d1a70f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.010422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.010457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.010662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.010738] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be0afb3-e7d1-4434-a78b-d41978d1a70f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.014016] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.014016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.014016] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a246dbb9-bbe3-4f92-8823-3c958f77d63e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.014016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.439392] env[69777]: INFO networking_nsxv3.common.synchronization [req-c58f7b43-a1b4-4437-8fed-1c04a54cbddf req-198d6b9c-ac4c-4ad2-84e1-bd94af8fd9a4 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_members [ 1109.439392] env[69777]: INFO networking_nsxv3.common.synchronization [req-c58f7b43-a1b4-4437-8fed-1c04a54cbddf req-198d6b9c-ac4c-4ad2-84e1-bd94af8fd9a4 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1109.439519] env[69777]: INFO networking_nsxv3.common.synchronization [req-c58f7b43-a1b4-4437-8fed-1c04a54cbddf req-198d6b9c-ac4c-4ad2-84e1-bd94af8fd9a4 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGHEST for action security_group_members [ 1109.442023] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_members [ 1109.442023] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1109.442023] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGHEST for action security_group_members [ 1109.442023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a246dbb9-bbe3-4f92-8823-3c958f77d63e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.442023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.442023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.442023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.442023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-07670245-7199-41ee-bb6c-b1ff49af92c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.442023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.442023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.442023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.442584] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.442584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.442584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.442584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.442584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.442584] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.462934] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.463817] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.513407] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.513582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.513738] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1be0afb3-e7d1-4434-a78b-d41978d1a70f with status ACTIVE [ 1109.513899] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.514016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.514307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.514307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.514425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.514724] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.514825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.514902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.515098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.515187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.515386] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.515483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.515548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.515699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.515779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.515867] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1be0afb3-e7d1-4434-a78b-d41978d1a70f is going to be updated. [ 1109.517116] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a246dbb9-bbe3-4f92-8823-3c958f77d63e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.517230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.536929] env[69777]: INFO networking_nsxv3.common.synchronization [req-c58f7b43-a1b4-4437-8fed-1c04a54cbddf req-198d6b9c-ac4c-4ad2-84e1-bd94af8fd9a4 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGHEST for action security_group_rules [ 1109.537133] env[69777]: INFO networking_nsxv3.common.synchronization [req-c58f7b43-a1b4-4437-8fed-1c04a54cbddf req-198d6b9c-ac4c-4ad2-84e1-bd94af8fd9a4 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGHEST for action security_group_members [ 1109.537278] env[69777]: INFO networking_nsxv3.common.synchronization [req-c58f7b43-a1b4-4437-8fed-1c04a54cbddf req-198d6b9c-ac4c-4ad2-84e1-bd94af8fd9a4 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1109.537410] env[69777]: INFO networking_nsxv3.common.synchronization [req-c58f7b43-a1b4-4437-8fed-1c04a54cbddf req-198d6b9c-ac4c-4ad2-84e1-bd94af8fd9a4 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1109.537538] env[69777]: INFO networking_nsxv3.common.synchronization [req-c58f7b43-a1b4-4437-8fed-1c04a54cbddf req-198d6b9c-ac4c-4ad2-84e1-bd94af8fd9a4 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_rules [ 1109.537668] env[69777]: INFO networking_nsxv3.common.synchronization [req-c58f7b43-a1b4-4437-8fed-1c04a54cbddf req-198d6b9c-ac4c-4ad2-84e1-bd94af8fd9a4 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_members [ 1109.537841] env[69777]: INFO networking_nsxv3.common.synchronization [req-c58f7b43-a1b4-4437-8fed-1c04a54cbddf req-198d6b9c-ac4c-4ad2-84e1-bd94af8fd9a4 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 1be0afb3-e7d1-4434-a78b-d41978d1a70f with Priority: HIGHEST for action port [ 1109.538891] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.539058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.539134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.539333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.539467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.539618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.540196] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGHEST for action security_group_rules [ 1109.540331] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1109.540444] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_members [ 1109.540551] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be0afb3-e7d1-4434-a78b-d41978d1a70f with Priority: HIGHEST for action port [ 1109.540713] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_rules [ 1109.540863] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGHEST for action security_group_members [ 1109.540977] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1109.541282] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07670245-7199-41ee-bb6c-b1ff49af92c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.541395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.541461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.541679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.541759] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.546176] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.546176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.546176] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a246dbb9-bbe3-4f92-8823-3c958f77d63e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.546176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.546176] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be0afb3-e7d1-4434-a78b-d41978d1a70f taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.546176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.546176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.546176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.546176] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be0afb3-e7d1-4434-a78b-d41978d1a70f',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.546176] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.546176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.546176] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-07670245-7199-41ee-bb6c-b1ff49af92c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.546176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.546176] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.546176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.946358] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.966026] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.969471] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.047032] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-07670245-7199-41ee-bb6c-b1ff49af92c4 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.047177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.047368] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1be0afb3-e7d1-4434-a78b-d41978d1a70f with status ACTIVE [ 1110.047539] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.047669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.047738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.047951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.048062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.048258] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.048364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.048428] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.048598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.048681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.049094] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.049094] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.049094] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.049216] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.049243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.049343] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1be0afb3-e7d1-4434-a78b-d41978d1a70f is going to be updated. [ 1110.070652] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.070945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.070945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.071117] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.071287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.071458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be0afb3-e7d1-4434-a78b-d41978d1a70f" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.389468] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: SUCCESS [ 1110.389805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.390061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.390332] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.390589] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.390732] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.390817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.392032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.392032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.392032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.392032] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.449356] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.469640] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.470232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.470232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.470232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.470232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.470404] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e is going to be created. [ 1110.471552] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.471667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.471733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.471900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.471981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.472078] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1110.497566] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.497738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.497858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.498162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.498372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.500225] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.500373] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.500443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.500637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.500799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.509467] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1110.510122] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: UNINITIALIZED for 2s [ 1110.893983] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.894360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.894360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.894906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.894906] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.894906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.894906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.894906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.895146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.895146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.895244] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.895336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.895395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.895538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.895764] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.895873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.895935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.896096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.896176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.896261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.896351] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.953565] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.953565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.953565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.953565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.953565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.953565] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 is going to be created. [ 1110.963605] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 934508a6-471e-40c3-b26e-4595587a983c in Status: SUCCESS [ 1110.963842] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 934508a6-471e-40c3-b26e-4595587a983c deletion is rescheduled due to dependency. [ 1110.963955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-934508a6-471e-40c3-b26e-4595587a983c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.977537] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.977682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.977756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.977960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.978145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.996787] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 in Status: UNINITIALIZED for 2s [ 1111.399722] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0519206-80b2-42a4-bf40-fb2cb2292017: rpc.has_security_group_logging(os_id): False [ 1111.422636] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.422826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.422901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.423504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.423504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.423630] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.423776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.423874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.424132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.424499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.424592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.424708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.426172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.426172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.426172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.426172] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.426172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.426172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.426172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.426172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.426172] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 is going to be updated. [ 1111.496356] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.496509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.496588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.496803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.496951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.508914] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: IN_PROGRESS for 2s [ 1112.521137] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1112.521493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.521554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.521765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.521956] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.522085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.522152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.522316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.522410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.522510] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.524654] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: SUCCESS [ 1112.524654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.524654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.524654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.524654] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.524654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.524889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.525100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.525183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.525273] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.007929] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 in Status: SUCCESS [ 1113.008199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.008368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.008622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.008791] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.008910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.008978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.009148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.009230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.009333] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.027354] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.028500] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.511674] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.524654] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: SUCCESS [ 1113.525641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.531647] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.532874] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.017920] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.035123] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.035287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.035360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.035587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.035681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.035786] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e is going to be updated. [ 1114.037204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.037326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.037388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.037570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.037655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.037753] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1114.066183] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.066183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.066183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.066451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.066491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.068609] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.068737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.068811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.069010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.069155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.078070] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1114.079263] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: IN_PROGRESS for 2s [ 1114.520831] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.521026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.521091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.521392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.521500] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.521635] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 is going to be updated. [ 1114.542098] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1114.542482] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=12 [ 1114.548761] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.548939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.548986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.549352] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.549633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.559520] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 in Status: IN_PROGRESS for 2s [ 1115.082146] env[69777]: INFO networking_nsxv3.common.synchronization [req-cdd0f59a-84db-4793-a400-04bf1dbc338e req-a19010e8-99f2-461b-9497-c5d2c0825c82 tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1115.082146] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1115.082684] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.082684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.082684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.082684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.082811] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.082875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.082935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.083185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.083267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.083384] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.499485] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.499485] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.499485] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.499485] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.499485] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.499485] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.499485] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.500189] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.500189] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.500189] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.500290] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.500388] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.500498] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.501612] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.501612] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.501612] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.521045] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.521233] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1115.521414] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.521604] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.521930] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-50b0e082-35d4-472c-96cd-463a75699673 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.522120] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-50b0e082-35d4-472c-96cd-463a75699673" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.522249] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-50b0e082-35d4-472c-96cd-463a75699673" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.522611] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-50b0e082-35d4-472c-96cd-463a75699673" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.522767] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b0e082-35d4-472c-96cd-463a75699673',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.587532] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.588166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.588166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.588166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.588166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.588376] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.588487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.588549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.588715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.588800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.588883] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 1115.619366] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.619516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.619592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.620079] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.620173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.628399] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 1116.025617] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.025851] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.025984] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.026318] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.026482] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.026646] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 50b0e082-35d4-472c-96cd-463a75699673 not found, creating... [ 1116.026914] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.027096] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.027222] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.027494] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.027650] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.027945] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.028121] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.028245] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.028459] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.028599] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.028741] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 50b0e082-35d4-472c-96cd-463a75699673 is going to be created. [ 1116.048522] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.048748] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.048879] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.049170] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.049429] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.049637] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-50b0e082-35d4-472c-96cd-463a75699673" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.089761] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1116.090055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.090267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.090476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.090825] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.090892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.090892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.091074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.091158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.091284] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.092753] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: SUCCESS [ 1116.092930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.093091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.093262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.093424] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.093572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.093657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.093815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.093879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.093966] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.569855] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 in Status: SUCCESS [ 1116.570092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.570312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.570538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.570735] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.570851] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.570917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.571075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.571170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.571269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.571349] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.595760] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.596722] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.784457] env[69777]: INFO networking_nsxv3.common.synchronization [req-cdd0f59a-84db-4793-a400-04bf1dbc338e req-1f969e59-719b-42c9-b40d-4c9cdb64e462 service nova] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_rules [ 1116.784653] env[69777]: INFO networking_nsxv3.common.synchronization [req-cdd0f59a-84db-4793-a400-04bf1dbc338e req-1f969e59-719b-42c9-b40d-4c9cdb64e462 service nova] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1116.784798] env[69777]: INFO networking_nsxv3.common.synchronization [req-cdd0f59a-84db-4793-a400-04bf1dbc338e req-1f969e59-719b-42c9-b40d-4c9cdb64e462 service nova] Enqueued Resource ID: 50b0e082-35d4-472c-96cd-463a75699673 with Priority: HIGHEST for action port [ 1116.785391] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_rules [ 1116.785534] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1116.785630] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50b0e082-35d4-472c-96cd-463a75699673 with Priority: HIGHEST for action port [ 1116.785914] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.786052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.786120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.786321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.786403] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.787280] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.787381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.787577] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-50b0e082-35d4-472c-96cd-463a75699673 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.787679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50b0e082-35d4-472c-96cd-463a75699673" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.787756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50b0e082-35d4-472c-96cd-463a75699673" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.787932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50b0e082-35d4-472c-96cd-463a75699673" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.788016] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b0e082-35d4-472c-96cd-463a75699673',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.073914] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.098407] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.099868] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.292205] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.292349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.292579] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50b0e082-35d4-472c-96cd-463a75699673 with status ACTIVE [ 1117.292876] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.293034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.293134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.293576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.293576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.293673] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.293808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.293888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.294069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.294147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.294351] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.294504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.294608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.294774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.294851] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.294941] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50b0e082-35d4-472c-96cd-463a75699673 is going to be updated. [ 1117.314922] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.315087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.315197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.315357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.315495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.315656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50b0e082-35d4-472c-96cd-463a75699673" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.576770] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07670245-7199-41ee-bb6c-b1ff49af92c4: rpc.has_security_group_logging(os_id): False [ 1117.596079] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.596385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.596385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.596514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.596599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.596825] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.596920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.596978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.597137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.597209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.597337] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 is going to be created. [ 1117.603544] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.603710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.603750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.603924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.604028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.604128] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1117.605429] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.605535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.605602] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.605770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.605847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.605932] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e is going to be updated. [ 1117.627942] env[69777]: INFO networking_nsxv3.common.synchronization [req-9f1d77c3-17fd-49c2-8fe2-bc51284d9fbd req-4a0efaab-d2dd-4a3a-b036-81f2d5336c8a tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_members [ 1117.628540] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_members [ 1117.629893] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-50bad828-a4cc-463b-9c54-306ad5358f8d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.630030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.630077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.630389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.630552] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.630655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.630719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.631508] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.631508] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.631508] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.640624] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.640769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.640853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.641362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.641542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.643949] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.643949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.644075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.644178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.644313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.650658] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 1117.650854] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 deletion is rescheduled due to dependency. [ 1117.651012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.651619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.651829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.652018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.652138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.652299] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.652483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.652589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.652669] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.654342] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1117.654654] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: IN_PROGRESS for 2s [ 1117.678765] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.678903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.678970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.679202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.679416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.689232] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 in Status: IN_PROGRESS for 2s [ 1118.134809] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.134983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.135077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.135304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.135398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.135592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.135705] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.135756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.135894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.136620] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.136620] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50bad828-a4cc-463b-9c54-306ad5358f8d already deleted. [ 1118.136620] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.156589] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.313328] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.313596] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.313734] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.314070] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.314347] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.314508] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.314828] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.314828] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.314984] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.315259] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1118.315380] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.315493] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.315604] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.315727] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1118.315837] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.316058] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.336084] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.336276] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1118.336423] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.336613] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.336945] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-f07d758e-0435-4dec-876d-25485bf59780 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.337139] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-f07d758e-0435-4dec-876d-25485bf59780" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.337265] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-f07d758e-0435-4dec-876d-25485bf59780" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.337636] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-f07d758e-0435-4dec-876d-25485bf59780" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.337780] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f07d758e-0435-4dec-876d-25485bf59780',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.658512] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.842205] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.843204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.843204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.843204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.843204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.843388] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port f07d758e-0435-4dec-876d-25485bf59780 not found, creating... [ 1118.843909] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.844105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.844237] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.844618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.844778] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.845109] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.845278] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.845402] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.845630] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.845768] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.845928] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: f07d758e-0435-4dec-876d-25485bf59780 is going to be created. [ 1118.866208] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.866442] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.866551] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.866840] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.867089] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.867323] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-f07d758e-0435-4dec-876d-25485bf59780" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.162712] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.162827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.162952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.163304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.163304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.163443] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 1119.196427] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.196639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.196639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.196891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.196985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.207852] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 1119.665605] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1119.665866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.666051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.666273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.666489] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.666612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.666652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.666773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.666847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.666946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.667038] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.668948] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: SUCCESS [ 1119.669141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.669308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.669515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.669698] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.669812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.670363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.670363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.670363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.670363] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.671033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.671322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.671411] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.671525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.671585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.672668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.672668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.672668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.672668] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.676715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.676715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.676715] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.676715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.676715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.676715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.676715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.676715] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.703555] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 in Status: SUCCESS [ 1119.703682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.002860] env[69777]: INFO networking_nsxv3.common.synchronization [req-9f1d77c3-17fd-49c2-8fe2-bc51284d9fbd req-20be739f-628f-407e-97aa-be50a2e523e5 service nova] Enqueued Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_rules [ 1120.003107] env[69777]: INFO networking_nsxv3.common.synchronization [req-9f1d77c3-17fd-49c2-8fe2-bc51284d9fbd req-20be739f-628f-407e-97aa-be50a2e523e5 service nova] Enqueued Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_members [ 1120.003336] env[69777]: INFO networking_nsxv3.common.synchronization [req-9f1d77c3-17fd-49c2-8fe2-bc51284d9fbd req-20be739f-628f-407e-97aa-be50a2e523e5 service nova] Enqueued Resource ID: f07d758e-0435-4dec-876d-25485bf59780 with Priority: HIGHEST for action port [ 1120.007020] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_rules [ 1120.007020] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_members [ 1120.007020] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f07d758e-0435-4dec-876d-25485bf59780 with Priority: HIGHEST for action port [ 1120.007020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50bad828-a4cc-463b-9c54-306ad5358f8d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.007020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.007020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.007020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.007020] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.007020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-50bad828-a4cc-463b-9c54-306ad5358f8d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.007020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.007020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.007020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.007020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.007020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.007020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.007020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.007020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.007020] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.007958] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f07d758e-0435-4dec-876d-25485bf59780 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.008096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f07d758e-0435-4dec-876d-25485bf59780" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.008151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f07d758e-0435-4dec-876d-25485bf59780" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.008380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f07d758e-0435-4dec-876d-25485bf59780" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.008454] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f07d758e-0435-4dec-876d-25485bf59780',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.173545] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.179027] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.179027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.179027] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.181995] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.511534] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-50bad828-a4cc-463b-9c54-306ad5358f8d taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.511619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.511923] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.512923] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f07d758e-0435-4dec-876d-25485bf59780 with status ACTIVE [ 1120.513140] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.513258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.513328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.513530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.513621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.513798] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.513896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.513958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.514730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.514922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.515116] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.515190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.515293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.515485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.515587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.515697] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f07d758e-0435-4dec-876d-25485bf59780 is going to be updated. [ 1120.536455] env[69777]: INFO networking_nsxv3.common.synchronization [req-7786b4ea-684f-450b-af06-5370d2558de0 req-b7299e32-0269-4582-9a5b-e0851aa686a6 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_members [ 1120.537563] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.537697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.537767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.539112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.539319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.539577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f07d758e-0435-4dec-876d-25485bf59780" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.542626] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_members [ 1120.542626] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b1a811-2cde-4056-af4d-31f7ea781dba taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.542626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.542626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.542626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.542626] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.542626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.542626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.542626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.542626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.542626] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.678645] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.681366] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a246dbb9-bbe3-4f92-8823-3c958f77d63e: rpc.has_security_group_logging(os_id): False [ 1120.686100] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.699868] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.700100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.700167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.700435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.700632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.700844] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.700950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.701025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.701233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.701314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.701403] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e is going to be created. [ 1120.760658] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.760809] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.760864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.761120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.761347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.786095] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: IN_PROGRESS for 2s [ 1121.018335] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.045711] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.045877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.045951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.046193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.046291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.046493] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.046594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.046655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.046814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.046893] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.046979] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b1a811-2cde-4056-af4d-31f7ea781dba already deleted. [ 1121.047077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.180340] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.180540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.180610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.180867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.180934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.181072] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1121.189615] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.189799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.189870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.190128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.190347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.190347] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e is going to be updated. [ 1121.218879] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.219088] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.219187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.219447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.219594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.222716] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.222836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.222904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.223109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.223239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.224775] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 1121.224947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.225638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.225852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.226203] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.226337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.226401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.226553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.226632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.226713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.226802] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.232557] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: IN_PROGRESS for 2s [ 1121.233768] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1121.521114] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.521114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.521114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.521114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.521114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.521114] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50bad828-a4cc-463b-9c54-306ad5358f8d is going to be created. [ 1121.546679] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.546679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.546679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.546679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.546679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.557413] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bad828-a4cc-463b-9c54-306ad5358f8d in Status: UNINITIALIZED for 2s [ 1121.586107] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.586862] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.587279] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.588086] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.588086] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.588878] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.592023] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.592023] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.592023] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.592023] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.592023] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.592023] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.592023] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.592023] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.592023] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.592023] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.622066] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.622066] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1121.622066] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.622066] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.622066] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-9ae94fb3-9395-4b2f-b23d-7f902801d568 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.622066] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-9ae94fb3-9395-4b2f-b23d-7f902801d568" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.622066] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-9ae94fb3-9395-4b2f-b23d-7f902801d568" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.622988] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-9ae94fb3-9395-4b2f-b23d-7f902801d568" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.623521] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae94fb3-9395-4b2f-b23d-7f902801d568',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.729434] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.729746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.729746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.731180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.731434] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.731557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.731626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.731854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.731939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.732055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.732208] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.732391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.732391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.735207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.735207] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.735207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.735207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.735207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.735207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.735207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.735207] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.129115] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.129273] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.129402] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.129775] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.129949] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.131723] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 9ae94fb3-9395-4b2f-b23d-7f902801d568 not found, creating... [ 1122.131723] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.131723] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.131723] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.131723] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.131723] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.132079] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.132487] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.134214] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.134494] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.134678] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.134790] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 9ae94fb3-9395-4b2f-b23d-7f902801d568 is going to be created. [ 1122.156779] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.157273] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.157463] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.157788] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.158101] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.158412] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-9ae94fb3-9395-4b2f-b23d-7f902801d568" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.237411] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2102ed9-efb2-4a2c-a170-b1e7872f4215: rpc.has_security_group_logging(os_id): False [ 1122.256331] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.257049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.257049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.257049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.257519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.257636] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.257852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.257948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.258341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.258484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.258765] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.258937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.259083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.259750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.259750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.259750] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.259750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.260162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.260162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.260518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.260710] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 1122.375476] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.375657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.375726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.375895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.376059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.392552] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 1122.799965] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: SUCCESS [ 1122.800343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.804525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.804610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.804752] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.206632] env[69777]: INFO networking_nsxv3.common.synchronization [req-7786b4ea-684f-450b-af06-5370d2558de0 req-4d0ec805-e8d8-4753-b6d1-4ac6580c6beb service nova] Enqueued Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_rules [ 1123.206632] env[69777]: INFO networking_nsxv3.common.synchronization [req-7786b4ea-684f-450b-af06-5370d2558de0 req-4d0ec805-e8d8-4753-b6d1-4ac6580c6beb service nova] Enqueued Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_members [ 1123.206632] env[69777]: INFO networking_nsxv3.common.synchronization [req-7786b4ea-684f-450b-af06-5370d2558de0 req-4d0ec805-e8d8-4753-b6d1-4ac6580c6beb service nova] Enqueued Resource ID: 9ae94fb3-9395-4b2f-b23d-7f902801d568 with Priority: HIGHEST for action port [ 1123.206632] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_rules [ 1123.206632] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_members [ 1123.211251] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae94fb3-9395-4b2f-b23d-7f902801d568 with Priority: HIGHEST for action port [ 1123.211793] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7b1a811-2cde-4056-af4d-31f7ea781dba taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.212104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.212283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.212724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.213327] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.214641] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b1a811-2cde-4056-af4d-31f7ea781dba taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.216013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.216013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.216013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.216013] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.216013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.216013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.216013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.216013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.216013] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.216987] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ae94fb3-9395-4b2f-b23d-7f902801d568 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.217138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ae94fb3-9395-4b2f-b23d-7f902801d568" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.217207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ae94fb3-9395-4b2f-b23d-7f902801d568" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.217495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ae94fb3-9395-4b2f-b23d-7f902801d568" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.217587] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae94fb3-9395-4b2f-b23d-7f902801d568',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.244431] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1123.244634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.245110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.246281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.247168] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.248222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.248222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.248222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.248222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.248222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.248222] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.248222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.248222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.248532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.248532] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.248608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.248608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.248734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.248813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.248900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.249054] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.250942] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: SUCCESS [ 1123.252440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.307811] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a246dbb9-bbe3-4f92-8823-3c958f77d63e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.307811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.307811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.308051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.308222] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.308312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.308446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.308543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.308634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.308725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.308813] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.570587] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bad828-a4cc-463b-9c54-306ad5358f8d in Status: SUCCESS [ 1123.570587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.570587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.571213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.571213] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.571213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.571213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.571507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.571507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.571507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.571633] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.592489] env[69777]: INFO networking_nsxv3.common.synchronization [req-d22ccca3-8d90-4502-81de-2dd202d14e7c req-ea770110-d8bd-4ba1-a8bc-db618dfb2908 tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1123.593671] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1123.593671] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.593671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.593671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.593938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.593938] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.594345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.594451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.594628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.594716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.594810] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.720692] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b1a811-2cde-4056-af4d-31f7ea781dba taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.720841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.721068] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.721909] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ae94fb3-9395-4b2f-b23d-7f902801d568 with status ACTIVE [ 1123.722066] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.722180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.722245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.722447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.722535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.722702] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.722800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.722865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.723020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.723098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.723277] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.723370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.723430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.723567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.723639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.723714] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ae94fb3-9395-4b2f-b23d-7f902801d568 is going to be updated. [ 1123.747047] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.747194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.747264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.747500] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.747665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.747826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ae94fb3-9395-4b2f-b23d-7f902801d568" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.755315] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6831ceb6-9d33-4058-9454-2d8e13eb4e86: rpc.has_security_group_logging(os_id): False [ 1123.774023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.774023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.774023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.774614] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.774614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.774614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.775107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.775317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.775494] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1123.793567] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.793765] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.793894] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.794190] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.794458] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.794621] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.794743] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.794957] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.796471] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.796799] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.796893] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.797016] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.797135] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.797305] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.800077] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.800345] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.810768] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.872841] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.872841] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.072 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1123.872841] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.872841] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.873649] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-1cc2966e-f081-466c-987d-8f4ab76952a3 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.873649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.873649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.874789] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.874789] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cc2966e-f081-466c-987d-8f4ab76952a3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.887575] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.887709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.887800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.887985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.890833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.893861] env[69777]: INFO networking_nsxv3.common.synchronization [req-3e81b161-ee97-4000-a735-40e064213535 req-ce68df18-e6c3-4621-8a95-80ec126aff60 tempest-ServerRescueNegativeTestJSON-1534204294 tempest-ServerRescueNegativeTestJSON-1534204294-project-member] Enqueued Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 1123.894717] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGHEST for action security_group_members [ 1123.896260] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.896411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.896483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.896774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.896942] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.897221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.899456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.899456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.899456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.899456] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.909905] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1124.076657] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.098083] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.229469] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.242436] env[69777]: INFO networking_nsxv3.common.synchronization [None req-bba13792-fe80-4cb6-b203-9829b8fb6079 None None] Enqueued Resource ID: 1fb5b33a-741e-476e-8547-567e2a7485f6 with Priority: HIGHEST for action port [ 1124.243392] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fb5b33a-741e-476e-8547-567e2a7485f6 with Priority: HIGHEST for action port [ 1124.244470] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fb5b33a-741e-476e-8547-567e2a7485f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.244617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fb5b33a-741e-476e-8547-567e2a7485f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.244654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fb5b33a-741e-476e-8547-567e2a7485f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.245149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fb5b33a-741e-476e-8547-567e2a7485f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.245149] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fb5b33a-741e-476e-8547-567e2a7485f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.312684] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a246dbb9-bbe3-4f92-8823-3c958f77d63e: rpc.has_security_group_logging(os_id): False [ 1124.331704] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.331704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.331704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.331704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.331704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.331704] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.331704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.331704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.331704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.332024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.332024] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e is going to be updated. [ 1124.379888] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.381097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.381097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.381097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.381097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.381097] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.381426] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.381426] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.382167] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.385022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.385022] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.385022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.385022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.385022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.385022] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.385022] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 1cc2966e-f081-466c-987d-8f4ab76952a3 is going to be updated. [ 1124.385980] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.386098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.386141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.386299] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.386428] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.400608] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.400792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.400879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.401182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.401235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.401512] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.401619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.401672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.401886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.401950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.401995] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 is going to be updated. [ 1124.403876] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 1124.404396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.405185] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: IN_PROGRESS for 2s [ 1124.409074] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.409318] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.409401] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.409688] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.409888] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.410128] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.461415] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.461649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.461776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.462012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.462180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.481134] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: IN_PROGRESS for 2s [ 1124.578469] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50bad828-a4cc-463b-9c54-306ad5358f8d: rpc.has_security_group_logging(os_id): False [ 1124.601329] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.606789] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.606933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.607053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.607253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.607342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.607601] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.607821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.607821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.607901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.607974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.608074] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50bad828-a4cc-463b-9c54-306ad5358f8d is going to be created. [ 1124.666402] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.666402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.666402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.666402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.666402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.676939] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50bad828-a4cc-463b-9c54-306ad5358f8d in Status: IN_PROGRESS for 2s [ 1124.735252] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.735252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.735252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.736764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.736764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.736764] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b1a811-2cde-4056-af4d-31f7ea781dba is going to be created. [ 1124.751095] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fb5b33a-741e-476e-8547-567e2a7485f6 [ 1124.751504] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.751652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.751721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.751997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.752132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.752740] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fb5b33a-741e-476e-8547-567e2a7485f6 already deleted. [ 1124.752740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fb5b33a-741e-476e-8547-567e2a7485f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.771477] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.771477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.771477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.771477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.771477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.786147] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b1a811-2cde-4056-af4d-31f7ea781dba in Status: UNINITIALIZED for 2s [ 1124.870152] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.870152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.870152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.870152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.870152] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.106037] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.106037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.106037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.106037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.106037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.106037] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1125.130226] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.130601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.131013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.131368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.131957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.141019] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1125.373927] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.441134] env[69777]: INFO networking_nsxv3.common.synchronization [req-7bda0361-7a2d-47cb-9ced-08ff31ea707d req-4af92d1e-a5ab-41cc-bd7a-148919b6dc55 service nova] Enqueued Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_rules [ 1125.441482] env[69777]: INFO networking_nsxv3.common.synchronization [req-7bda0361-7a2d-47cb-9ced-08ff31ea707d req-4af92d1e-a5ab-41cc-bd7a-148919b6dc55 service nova] Enqueued Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_members [ 1125.442077] env[69777]: INFO networking_nsxv3.common.synchronization [req-7bda0361-7a2d-47cb-9ced-08ff31ea707d req-4af92d1e-a5ab-41cc-bd7a-148919b6dc55 service nova] Enqueued Resource ID: 1cc2966e-f081-466c-987d-8f4ab76952a3 with Priority: HIGHEST for action port [ 1125.442973] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_rules [ 1125.443859] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_members [ 1125.444054] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cc2966e-f081-466c-987d-8f4ab76952a3 with Priority: HIGHEST for action port [ 1125.444477] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.444676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.445382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.446230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.446324] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.449024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.449024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.449024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.449024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.449024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.449024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.449024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.449024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.449024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.449024] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.449470] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cc2966e-f081-466c-987d-8f4ab76952a3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.449541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.449607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.449758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.449828] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cc2966e-f081-466c-987d-8f4ab76952a3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.877769] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.921689] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1125.922026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.922202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.922369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.922428] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.951823] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.952071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.952139] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.953419] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1cc2966e-f081-466c-987d-8f4ab76952a3 with status ACTIVE [ 1125.953531] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.953652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.953731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.953914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.954008] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.954188] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.954287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.954356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.954507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.954573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.955891] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.955891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.955891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.955891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.956300] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.956300] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1cc2966e-f081-466c-987d-8f4ab76952a3 is going to be updated. [ 1125.976398] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.976546] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.976636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.976867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.977025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.977196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cc2966e-f081-466c-987d-8f4ab76952a3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.382788] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1126.382788] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1126.416723] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: SUCCESS [ 1126.416953] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.429864] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.429864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.429864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.429864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.429864] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.429864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.429864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.429864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.429864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.429864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.429864] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.458359] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.494470] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 in Status: SUCCESS [ 1126.494470] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 deletion is rescheduled due to dependency. [ 1126.494538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.573618] env[69777]: INFO networking_nsxv3.common.synchronization [None req-4a2110a2-6de2-4f89-ad13-f832907f7b04 None None] Enqueued Resource ID: ba748cf8-08ad-45bc-b5d7-a6a77c8bd75b with Priority: HIGHEST for action port [ 1126.573618] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba748cf8-08ad-45bc-b5d7-a6a77c8bd75b with Priority: HIGHEST for action port [ 1126.573862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba748cf8-08ad-45bc-b5d7-a6a77c8bd75b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.574029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba748cf8-08ad-45bc-b5d7-a6a77c8bd75b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.574731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba748cf8-08ad-45bc-b5d7-a6a77c8bd75b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.574731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba748cf8-08ad-45bc-b5d7-a6a77c8bd75b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.574731] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba748cf8-08ad-45bc-b5d7-a6a77c8bd75b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.688838] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50bad828-a4cc-463b-9c54-306ad5358f8d in Status: SUCCESS [ 1126.690607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.802807] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b1a811-2cde-4056-af4d-31f7ea781dba in Status: SUCCESS [ 1126.802807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.802807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.802807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.802807] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.802807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.802807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.802807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.802807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.802807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.802807] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.932096] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.932444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.932444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.932584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.932822] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.932935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.933042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.933253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.933347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.933459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.933643] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.933749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.933826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.934232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.934326] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.934400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.934472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.934654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.934759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.934926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.935283] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.961064] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.961228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.961376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.961715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.961767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.961844] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 is going to be updated. [ 1126.990710] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.990870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.991061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.991139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.991345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.000566] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 in Status: IN_PROGRESS for 2s [ 1127.076651] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba748cf8-08ad-45bc-b5d7-a6a77c8bd75b [ 1127.077636] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.077799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.077890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.078171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.078337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.078460] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba748cf8-08ad-45bc-b5d7-a6a77c8bd75b already deleted. [ 1127.078599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba748cf8-08ad-45bc-b5d7-a6a77c8bd75b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.151575] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1127.151575] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.236441] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.236639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.236639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.237234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.252384] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1127.253382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.255591] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1127.306985] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.312546] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.312703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.312816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.313067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.324691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.325717] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1127.325717] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1127.325717] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1127.372216] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.372371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.372684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.372755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.375299] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.375299] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1127.437787] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6831ceb6-9d33-4058-9454-2d8e13eb4e86: rpc.has_security_group_logging(os_id): False [ 1127.462675] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.462834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.463703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.463703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.484826] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.485090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.485170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.485805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.485805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.486189] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1127.489427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.489736] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.489869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.489972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.490723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.490723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.490723] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.490723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.490723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.490968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.491203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.491317] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.492014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.492014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.492014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.492014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.492014] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1127.560031] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.560031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.560031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.560031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.560031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.575782] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.576823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.576930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.577276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.577550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.577930] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1127.578072] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7ceaf97c-1feb-4a95-a759-71b6308c5c38', '4cb60d30-acd9-42ec-9942-d71d6c7c14f6', '9aba63da-4cec-4d01-bddd-3245f04bb8e3', 'f64a4b87-9b99-4306-97e4-e97d2b7d7388', 'bb5e9a12-ae77-432f-9642-7c6f122d8264', '19a7e89f-21d0-44aa-b9fb-f52ca92dc496', 'dd51d8a4-0c41-4e95-a3e3-1f0da556ee84', '3a1bf12c-bf27-489b-97e0-b447bcaa1329', 'df000c73-dfce-4f6a-a3af-75deec8fae28', 'c23d2309-9b2a-41c1-ba25-e613842d4d53', 'a7a5ca58-1bdc-49d1-821b-3e40291a7c15', '07670245-7199-41ee-bb6c-b1ff49af92c4', 'cc849ff0-58d8-4b9a-9f49-53853fea6a2e', 'af922b11-ba63-48cf-97cd-b04487c3e7f1', '3a80d85d-9154-4a27-bab2-481460122696', 'ad5575ce-f5cd-4af5-9757-424d93034877', '4058bf2e-e500-4002-898a-0d2b9aa510e5', 'fff25930-cb45-4041-b401-1bef6155831b', '4eabc2a2-99dc-4c4c-844b-193f2dc6c288', 'd2102ed9-efb2-4a2c-a170-b1e7872f4215', '472e5966-9eb6-4e5f-91b6-9f0b0df9c87e', 'a246dbb9-bbe3-4f92-8823-3c958f77d63e', '2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0', '50bad828-a4cc-463b-9c54-306ad5358f8d', '54f2e457-46a8-40bd-9513-a556b213a51c', '558602f0-d46e-4c1e-9820-0cf4971db17b', 'ec67cf45-130c-446e-bc7a-8c1eb32450c7', '96e24b09-4a12-4902-8139-2df8e6a535e0', '06bee688-2b64-4a9b-b0eb-ee4c735a9c41', 'f44fd483-f70f-4a69-967b-e48536b42565', '5ee1d406-4eef-4a6f-9340-fafaa839ac55', 'bf7f4ddc-ed21-4d94-8cea-71e39c933549', '934508a6-471e-40c3-b26e-4595587a983c', '6831ceb6-9d33-4058-9454-2d8e13eb4e86', '54ece09a-8f35-4152-a654-20e3b05650f5', '15fc107d-52a0-4aa7-83cd-a96824b186f6', 'dfc00e54-a878-499a-acb4-f2b1c4844df7', 'd94c1310-5466-4ce7-9d83-c7c474aa637e', '34d3f208-bbb4-4415-9934-a2683e967524', 'c31a3d66-3f9b-4509-bdc2-763f23333743', 'c0519206-80b2-42a4-bf40-fb2cb2292017', 'aa84311d-f462-487f-91c4-49b7e8315838', 'cf27a656-ea7d-4a2d-b6f9-fe71cbf46653', '9c1512ec-3cb3-4a3e-9626-035d7eea4067', '47227221-8e24-429f-b3e4-917bd42f6a48'} {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1127.578245] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1127.580409] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1127.608464] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.608464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.608709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.608830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.608957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.609305] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1127.609305] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1127.609503] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1127.691306] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.691558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.691675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.691949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.693111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.694282] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1127.694450] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1127.694809] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1127.695250] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1127.695357] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1127.695461] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGH for action security_group_rules [ 1127.695627] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGH for action security_group_rules [ 1127.695627] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGH for action security_group_rules [ 1127.695778] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGH for action security_group_rules [ 1127.695778] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 with Priority: HIGH for action security_group_rules [ 1127.695835] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGH for action security_group_rules [ 1127.695904] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGH for action security_group_rules [ 1127.695947] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fff25930-cb45-4041-b401-1bef6155831b with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGH for action security_group_rules [ 1127.699377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.810667] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7b1a811-2cde-4056-af4d-31f7ea781dba: rpc.has_security_group_logging(os_id): False [ 1127.831245] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.831245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.831245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.831245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.831245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.831245] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.831245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.831245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.831245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.831245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.831245] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7b1a811-2cde-4056-af4d-31f7ea781dba is going to be created. [ 1127.888658] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.888874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.888874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.892023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.892023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.903442] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7b1a811-2cde-4056-af4d-31f7ea781dba in Status: IN_PROGRESS for 2s [ 1129.009123] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 in Status: SUCCESS [ 1129.009123] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.009866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.009866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.009866] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.009866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.009866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.010034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.010062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.010163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.010287] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.513559] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.597092] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1129.597336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.921403] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7b1a811-2cde-4056-af4d-31f7ea781dba in Status: SUCCESS [ 1129.921731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.015357] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec67cf45-130c-446e-bc7a-8c1eb32450c7: rpc.has_security_group_logging(os_id): False [ 1130.035044] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.037461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.037461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.037461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.056355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.056355] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.056355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.056355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.056355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.056355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.056355] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 is going to be updated. [ 1130.111317] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.111700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.111855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.112234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.112539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.123431] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 in Status: IN_PROGRESS for 2s [ 1130.151244] env[69777]: INFO networking_nsxv3.common.synchronization [req-494cd426-d5dd-4908-8220-b0712f5c9c9c req-dee859d1-70d6-412b-9588-0b7cd45595b6 tempest-ServerActionsTestOtherB-1106354566 tempest-ServerActionsTestOtherB-1106354566-project-member] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1130.151714] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1130.152061] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 with Priority: HIGH for action security_group_rules [ 1130.152383] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 with Priority: HIGH for action security_group_rules [ 1130.152854] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGH for action security_group_rules [ 1130.153107] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGH for action security_group_rules [ 1130.153322] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGH for action security_group_rules [ 1130.153649] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 with Priority: HIGH for action security_group_rules [ 1130.153872] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff25930-cb45-4041-b401-1bef6155831b with Priority: HIGH for action security_group_rules [ 1130.154108] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 with Priority: HIGH for action security_group_rules [ 1130.154313] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 with Priority: HIGH for action security_group_rules [ 1130.154534] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5575ce-f5cd-4af5-9757-424d93034877 with Priority: HIGH for action security_group_rules [ 1130.154733] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e with Priority: HIGH for action security_group_rules [ 1130.154927] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGH for action security_group_rules [ 1130.155157] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 with Priority: HIGH for action security_group_rules [ 1130.155360] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 with Priority: HIGH for action security_group_rules [ 1130.155554] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df000c73-dfce-4f6a-a3af-75deec8fae28 with Priority: HIGH for action security_group_rules [ 1130.155773] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 with Priority: HIGH for action security_group_rules [ 1130.155973] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 with Priority: HIGH for action security_group_rules [ 1130.156201] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 with Priority: HIGH for action security_group_rules [ 1130.159021] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGH for action security_group_rules [ 1130.159021] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGH for action security_group_rules [ 1130.159021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.159021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.159021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.159021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.159021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.159021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.159021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.159021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.159021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.159021] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.160559] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.160829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.160999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.161277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.161481] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceaf97c-1feb-4a95-a759-71b6308c5c38',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.167157] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.167850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.168127] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.168545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.168817] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9aba63da-4cec-4d01-bddd-3245f04bb8e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.173038] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.173038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.173038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.173038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.173038] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.174381] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.174833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.175067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.175421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.175751] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.177340] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.177689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.179031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.179031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.179031] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.182323] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.182671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.182873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.183209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.183499] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eabc2a2-99dc-4c4c-844b-193f2dc6c288',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.184649] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fff25930-cb45-4041-b401-1bef6155831b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.184953] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.189033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.189033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.189033] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fff25930-cb45-4041-b401-1bef6155831b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.189033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4058bf2e-e500-4002-898a-0d2b9aa510e5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.189033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.189033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.189033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.189033] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4058bf2e-e500-4002-898a-0d2b9aa510e5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.189033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af922b11-ba63-48cf-97cd-b04487c3e7f1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.189033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.189033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.189033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.189033] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af922b11-ba63-48cf-97cd-b04487c3e7f1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.191912] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad5575ce-f5cd-4af5-9757-424d93034877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.191912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.191912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.192485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.192929] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad5575ce-f5cd-4af5-9757-424d93034877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.194701] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.194849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.195369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.195632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.195763] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc849ff0-58d8-4b9a-9f49-53853fea6a2e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.196666] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07670245-7199-41ee-bb6c-b1ff49af92c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.196820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.196896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.197349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.197349] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.198026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7a5ca58-1bdc-49d1-821b-3e40291a7c15 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.198164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.198266] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.198503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.198715] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7a5ca58-1bdc-49d1-821b-3e40291a7c15',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.199549] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c23d2309-9b2a-41c1-ba25-e613842d4d53 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.199695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.199800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.200016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.200237] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c23d2309-9b2a-41c1-ba25-e613842d4d53',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.200964] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df000c73-dfce-4f6a-a3af-75deec8fae28 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.201478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.202260] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.202260] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.202260] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df000c73-dfce-4f6a-a3af-75deec8fae28',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.202940] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.203085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.203160] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.203480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.203480] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19a7e89f-21d0-44aa-b9fb-f52ca92dc496',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.204529] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.204529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.204635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.204750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.204853] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a1bf12c-bf27-489b-97e0-b447bcaa1329',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.206520] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb5e9a12-ae77-432f-9642-7c6f122d8264 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.206520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.206520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.206520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.206520] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb5e9a12-ae77-432f-9642-7c6f122d8264',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.207411] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.207411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.207411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.207411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.207702] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.208373] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.208491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.208580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.208733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.208806] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.215566] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.215739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.215788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.215971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.216158] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.216267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.216344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.216503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.216596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.216682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.216767] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.244591] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.245999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.245999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.245999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.247223] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.247377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.266764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.266957] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9aba63da-4cec-4d01-bddd-3245f04bb8e3 is going to be deleted. [ 1130.267931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.268178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.286270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.288201] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df000c73-dfce-4f6a-a3af-75deec8fae28 is going to be deleted. [ 1130.321647] env[69777]: INFO networking_nsxv3.common.synchronization [None req-b59080cb-7df4-4edb-bd00-a21c6798ef1d None None] Enqueued Resource ID: 06508b9b-1db0-4d0c-8dc5-01c51d5c61b6 with Priority: HIGHEST for action port [ 1130.321647] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.321647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.321647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.321647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.321647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.321647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9aba63da-4cec-4d01-bddd-3245f04bb8e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.321647] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06508b9b-1db0-4d0c-8dc5-01c51d5c61b6 with Priority: HIGHEST for action port [ 1130.322147] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-06508b9b-1db0-4d0c-8dc5-01c51d5c61b6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.322284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06508b9b-1db0-4d0c-8dc5-01c51d5c61b6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.322375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06508b9b-1db0-4d0c-8dc5-01c51d5c61b6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.322691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06508b9b-1db0-4d0c-8dc5-01c51d5c61b6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.322878] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06508b9b-1db0-4d0c-8dc5-01c51d5c61b6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.341467] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.341639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.341698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.341970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.342159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.342436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df000c73-dfce-4f6a-a3af-75deec8fae28" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.712572] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.712829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.712940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.713234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.713424] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.713578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.713644] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.713876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.714009] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.714125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.714221] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.728475] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.728650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.728935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.729178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.742449] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.745930] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-07670245-7199-41ee-bb6c-b1ff49af92c4 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.747099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.747099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.747099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.747099] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.747099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.747099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.747099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.747099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.747642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.747642] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.749966] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f64a4b87-9b99-4306-97e4-e97d2b7d7388 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.750117] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.750224] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.750512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.752830] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.752830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.752830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.752830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.752830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.752830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.752830] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.752830] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.752830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.752830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.752830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.753507] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.753507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.753507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.753507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.753507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.753507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.753688] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.753729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.754469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.754469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.754469] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.754469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.754469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.754469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.754469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.755090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.755090] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.820760] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.820901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.822038] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.822153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.822900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.823131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.823918] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.824070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.825285] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.825398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.826203] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.826290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.827112] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.827275] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.828391] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.828391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.829021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.829165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.829995] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.830420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.831257] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1130.831665] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.831939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.832453] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06508b9b-1db0-4d0c-8dc5-01c51d5c61b6 [ 1130.832453] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.832453] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.832610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.832779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.832889] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.833049] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06508b9b-1db0-4d0c-8dc5-01c51d5c61b6 already deleted. [ 1130.834217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06508b9b-1db0-4d0c-8dc5-01c51d5c61b6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.834217] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1130.834603] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.834773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.835482] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1130.835979] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.836134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.836853] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1130.837366] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.837465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.839137] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1130.839632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.839848] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.839962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.840042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.840595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.840697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.840788] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 1130.842860] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.843046] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.843186] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.843617] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.843893] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.844076] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.844272] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.844604] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.844773] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.845000] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.845141] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.845256] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.845484] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.845700] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.845863] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.846026] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.848157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.848157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.848157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.848157] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be deleted. [ 1130.849119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.849385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.876783] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.876962] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1130.877119] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.877297] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.877623] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-a487be97-10ab-4454-a23a-5d31cbdba5ce taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.877862] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-a487be97-10ab-4454-a23a-5d31cbdba5ce" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.881234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-a487be97-10ab-4454-a23a-5d31cbdba5ce" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.881234] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-a487be97-10ab-4454-a23a-5d31cbdba5ce" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.881234] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a487be97-10ab-4454-a23a-5d31cbdba5ce',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.883798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.883915] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c23d2309-9b2a-41c1-ba25-e613842d4d53 is going to be deleted. [ 1130.884949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.885191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.898834] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.899054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.899163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.899536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.899615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.907779] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1130.919462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.919462] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be deleted. [ 1130.919462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.919579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.923218] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.923321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.939692] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.939692] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.944965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.944965] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4058bf2e-e500-4002-898a-0d2b9aa510e5 is going to be deleted. [ 1130.946264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.946507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.966590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.966590] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7a5ca58-1bdc-49d1-821b-3e40291a7c15 is going to be deleted. [ 1130.967115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.967341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.980309] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.980309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.011666] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.012431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.020126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.020126] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad5575ce-f5cd-4af5-9757-424d93034877 is going to be deleted. [ 1131.020126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.020126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.067536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.067581] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb5e9a12-ae77-432f-9642-7c6f122d8264 is going to be deleted. [ 1131.068536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.068746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.121795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.121975] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eabc2a2-99dc-4c4c-844b-193f2dc6c288 is going to be deleted. [ 1131.122846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.123065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.124736] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.124871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.126668] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.126789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.158384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.162023] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af922b11-ba63-48cf-97cd-b04487c3e7f1 is going to be deleted. [ 1131.162023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.162023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.196036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.196036] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceaf97c-1feb-4a95-a759-71b6308c5c38 is going to be deleted. [ 1131.196036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.196036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.198998] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.198998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.208139] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.208139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.218644] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.218756] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fff25930-cb45-4041-b401-1bef6155831b is going to be deleted. [ 1131.223502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.223786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.229798] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.229798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.258070] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.258571] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.259694] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2102ed9-efb2-4a2c-a170-b1e7872f4215: rpc.has_security_group_logging(os_id): False [ 1131.262978] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb60d30-acd9-42ec-9942-d71d6c7c14f6: rpc.has_security_group_logging(os_id): False [ 1131.275555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.275555] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a1bf12c-bf27-489b-97e0-b447bcaa1329 is going to be deleted. [ 1131.276826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.276826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.288698] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.288852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.289761] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.289898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.291173] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.291173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.362730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.362894] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a7e89f-21d0-44aa-b9fb-f52ca92dc496 is going to be deleted. [ 1131.364670] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.364795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.364866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.368980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.369590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.369590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fff25930-cb45-4041-b401-1bef6155831b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.370015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.370379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.381448] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.381768] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.382261] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.382416] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.382709] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.382949] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port a487be97-10ab-4454-a23a-5d31cbdba5ce not found, creating... [ 1131.383430] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.383742] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.383928] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.384239] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.384603] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.384941] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.385769] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.385769] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.385769] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.385769] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.386182] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: a487be97-10ab-4454-a23a-5d31cbdba5ce is going to be created. [ 1131.434871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.434871] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc849ff0-58d8-4b9a-9f49-53853fea6a2e is going to be deleted. [ 1131.435353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.435566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.435658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.435846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c23d2309-9b2a-41c1-ba25-e613842d4d53" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.435931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.436093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.436169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.436279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.436801] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.437215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.437215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.439663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4058bf2e-e500-4002-898a-0d2b9aa510e5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.439818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.439989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.440090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.440196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7a5ca58-1bdc-49d1-821b-3e40291a7c15" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.440333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.440550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.440626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.440740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad5575ce-f5cd-4af5-9757-424d93034877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.440873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.441032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.441081] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.441187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb5e9a12-ae77-432f-9642-7c6f122d8264" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.441316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.441459] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.441530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.441643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eabc2a2-99dc-4c4c-844b-193f2dc6c288" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.441760] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.441893] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.441966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.442093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af922b11-ba63-48cf-97cd-b04487c3e7f1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.442253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.442356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.458569] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.458837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.463865] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.464737] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.464737] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.464737] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.464954] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.465123] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-a487be97-10ab-4454-a23a-5d31cbdba5ce" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.480610] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.481046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.482080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.482404] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.482460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.482527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.482895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.482895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.483054] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.483180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.483245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.483408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.483733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.483733] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.483859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.483859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.484012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.484256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.484256] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 1131.485336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.485525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.485649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.485800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceaf97c-1feb-4a95-a759-71b6308c5c38" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.485972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.486891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.553412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.553776] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.553776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.553776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.555844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.555844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.555844] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 is going to be updated. [ 1131.557158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.558479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.558603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.558769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a1bf12c-bf27-489b-97e0-b447bcaa1329" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.558908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.559087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.559177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.559285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19a7e89f-21d0-44aa-b9fb-f52ca92dc496" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.559448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.559804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.559914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.560069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.626325] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.626484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.626558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.626773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.626857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.626986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc849ff0-58d8-4b9a-9f49-53853fea6a2e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.628139] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.628274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.628343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.628512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.628656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.670135] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 1131.727609] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.727828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.727899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.728129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.728300] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.760469] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: IN_PROGRESS for 2s [ 1131.760962] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f64a4b87-9b99-4306-97e4-e97d2b7d7388: rpc.has_security_group_logging(os_id): False [ 1131.765521] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07670245-7199-41ee-bb6c-b1ff49af92c4: rpc.has_security_group_logging(os_id): False [ 1131.785644] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.785826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.785909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.786147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.808717] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.808862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.841795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.841795] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.841795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.841795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.841795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.841795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.841795] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 is going to be updated. [ 1131.842830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.842967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.863159] env[69777]: INFO networking_nsxv3.common.synchronization [req-01f38724-b048-4dff-9893-e146ebe00f04 req-c5d36826-1293-4f0f-94c7-318b32642733 tempest-SecurityGroupRulesNegativeTestJSON-833898787 tempest-SecurityGroupRulesNegativeTestJSON-833898787-project-member] Enqueued Resource ID: a3d2eee2-5821-46de-90f7-6348e5c0cb34 with Priority: HIGHEST for action security_group_rules [ 1131.863159] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3d2eee2-5821-46de-90f7-6348e5c0cb34 with Priority: HIGHEST for action security_group_rules [ 1131.866405] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3d2eee2-5821-46de-90f7-6348e5c0cb34 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.866405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3d2eee2-5821-46de-90f7-6348e5c0cb34" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.866405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3d2eee2-5821-46de-90f7-6348e5c0cb34" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.866405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3d2eee2-5821-46de-90f7-6348e5c0cb34" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.866405] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3d2eee2-5821-46de-90f7-6348e5c0cb34',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.888173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.888533] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.889937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.890084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.890318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.890476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.890605] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 is going to be updated. [ 1131.938515] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.938651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.938651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.938835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.938987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.942987] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.943120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.943198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.943388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.943540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.951591] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 in Status: IN_PROGRESS for 2s [ 1131.953688] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 in Status: IN_PROGRESS for 2s [ 1132.124017] env[69777]: INFO networking_nsxv3.common.synchronization [req-6c77c36e-2a54-44b0-b738-1c0ccfeae2ce req-8d139383-5e33-49ee-8fe5-cb17da7b3eab tempest-SecurityGroupRulesNegativeTestJSON-833898787 tempest-SecurityGroupRulesNegativeTestJSON-833898787-project-member] Enqueued Resource ID: a3d2eee2-5821-46de-90f7-6348e5c0cb34 with Priority: HIGHEST for action security_group_rules [ 1132.126337] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3d2eee2-5821-46de-90f7-6348e5c0cb34 with Priority: HIGHEST for action security_group_rules [ 1132.126813] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3d2eee2-5821-46de-90f7-6348e5c0cb34 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.127130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3d2eee2-5821-46de-90f7-6348e5c0cb34" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.140028] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 in Status: SUCCESS [ 1132.140255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.229025] env[69777]: INFO networking_nsxv3.common.synchronization [None req-a196ba50-f1bf-4a76-967e-345cb6eae54a None None] Enqueued Resource ID: 4fafc7ed-5f26-47e3-afba-7b52d96853d1 with Priority: HIGHEST for action port [ 1132.229025] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fafc7ed-5f26-47e3-afba-7b52d96853d1 with Priority: HIGHEST for action port [ 1132.229025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fafc7ed-5f26-47e3-afba-7b52d96853d1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.229025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fafc7ed-5f26-47e3-afba-7b52d96853d1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.229025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fafc7ed-5f26-47e3-afba-7b52d96853d1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.229025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fafc7ed-5f26-47e3-afba-7b52d96853d1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.229025] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fafc7ed-5f26-47e3-afba-7b52d96853d1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.261176] env[69777]: INFO networking_nsxv3.common.synchronization [req-494cd426-d5dd-4908-8220-b0712f5c9c9c req-4694f491-3bf8-47cc-97d5-5690635469e7 service nova] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 1132.261176] env[69777]: INFO networking_nsxv3.common.synchronization [req-494cd426-d5dd-4908-8220-b0712f5c9c9c req-4694f491-3bf8-47cc-97d5-5690635469e7 service nova] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1132.261176] env[69777]: INFO networking_nsxv3.common.synchronization [req-494cd426-d5dd-4908-8220-b0712f5c9c9c req-4694f491-3bf8-47cc-97d5-5690635469e7 service nova] Enqueued Resource ID: a487be97-10ab-4454-a23a-5d31cbdba5ce with Priority: HIGHEST for action port [ 1132.261176] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 1132.261176] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1132.261176] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a487be97-10ab-4454-a23a-5d31cbdba5ce with Priority: HIGHEST for action port [ 1132.261618] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.262201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.262201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.262402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.262488] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.263368] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.263579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.265031] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-a487be97-10ab-4454-a23a-5d31cbdba5ce taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.265031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a487be97-10ab-4454-a23a-5d31cbdba5ce" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.265031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a487be97-10ab-4454-a23a-5d31cbdba5ce" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.265031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a487be97-10ab-4454-a23a-5d31cbdba5ce" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.265031] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a487be97-10ab-4454-a23a-5d31cbdba5ce',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.393792] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.393792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.393792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.393792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.393792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.393792] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3d2eee2-5821-46de-90f7-6348e5c0cb34 already deleted. [ 1132.393792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3d2eee2-5821-46de-90f7-6348e5c0cb34" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.393792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3d2eee2-5821-46de-90f7-6348e5c0cb34" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.393792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3d2eee2-5821-46de-90f7-6348e5c0cb34" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.393792] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3d2eee2-5821-46de-90f7-6348e5c0cb34',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.735213] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fafc7ed-5f26-47e3-afba-7b52d96853d1 [ 1132.735213] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.735213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.735213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.735464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.735568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.735615] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fafc7ed-5f26-47e3-afba-7b52d96853d1 already deleted. [ 1132.735675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fafc7ed-5f26-47e3-afba-7b52d96853d1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.766407] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.766581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.766835] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a487be97-10ab-4454-a23a-5d31cbdba5ce with status ACTIVE [ 1132.767093] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.767211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.767276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.767505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.767595] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.767845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.767948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.768014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.769080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.769080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.769080] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.769080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.769080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.769080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.769080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.769080] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a487be97-10ab-4454-a23a-5d31cbdba5ce is going to be updated. [ 1132.791063] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.791063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.791063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.791063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.791063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.791063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a487be97-10ab-4454-a23a-5d31cbdba5ce" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.917865] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.918028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.918092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.918092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.918531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.918634] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3d2eee2-5821-46de-90f7-6348e5c0cb34 already deleted. [ 1132.918746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3d2eee2-5821-46de-90f7-6348e5c0cb34" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.920109] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1132.920287] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 deletion is rescheduled due to dependency. [ 1132.920449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.921373] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.921683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.921961] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.922778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.922778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.922778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.922778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.922778] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.428153] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.684628] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 1133.684912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.779080] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: SUCCESS [ 1133.779532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.930275] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.963666] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 in Status: SUCCESS [ 1133.963966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.965535] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 in Status: SUCCESS [ 1133.965751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.434696] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.435118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.435493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.436116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.436116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.436116] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 1134.466363] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.466363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.466363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.466363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.466363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.474977] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1136.439979] env[69777]: INFO networking_nsxv3.common.synchronization [req-0a60c03b-80b3-4846-9a79-1d8165a22c89 req-0881ba71-47a3-4a02-a0cc-b29dbd3d7fd0 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1136.440616] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1136.440962] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.441643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.441724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.441945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.442484] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.442583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.442651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.442830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.444265] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.444392] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.490327] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1136.490650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.491220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.491729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.491931] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.492062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.492128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.492297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.492562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.492654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.492746] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.946818] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.947208] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-383" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.947348] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-383" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.947726] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-383" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.948761] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.949105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.949274] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.949605] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.949800] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.950160] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.950330] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.950560] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.950682] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.950819] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.950973] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.951102] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.954614] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.976555] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.976555] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1136.976778] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.976869] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-383" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.977356] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-94cf2407-eea6-443c-843d-93034322bf97 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.977580] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.977722] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.978890] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.980284] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94cf2407-eea6-443c-843d-93034322bf97',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.996193] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.458752] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.486843] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.486843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.486843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.486843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.486843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.486843] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 94cf2407-eea6-443c-843d-93034322bf97 not found, creating... [ 1137.486843] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.486843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.486843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.486843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.486843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.487649] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.487649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.487649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.487649] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.489097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.489465] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 94cf2407-eea6-443c-843d-93034322bf97 is going to be created. [ 1137.498766] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd51d8a4-0c41-4e95-a3e3-1f0da556ee84: rpc.has_security_group_logging(os_id): False [ 1137.518024] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.518024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.518024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.518024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.518024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.518024] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.519048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.519318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.519479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.519757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.522016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.522016] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.522016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.522016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.522016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.522016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.522016] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be created. [ 1137.584342] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.584506] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.584574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.584787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.584966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.600531] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1137.962314] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.962509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.962586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.962802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.962879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.962989] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1137.993945] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.993945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.993945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.994163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.994310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.004196] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1138.316443] env[69777]: INFO networking_nsxv3.common.synchronization [req-0a60c03b-80b3-4846-9a79-1d8165a22c89 req-5c70fee2-54c2-43dd-a97d-19d78b80f287 service nova] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1138.316443] env[69777]: INFO networking_nsxv3.common.synchronization [req-0a60c03b-80b3-4846-9a79-1d8165a22c89 req-5c70fee2-54c2-43dd-a97d-19d78b80f287 service nova] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1138.316443] env[69777]: INFO networking_nsxv3.common.synchronization [req-0a60c03b-80b3-4846-9a79-1d8165a22c89 req-5c70fee2-54c2-43dd-a97d-19d78b80f287 service nova] Enqueued Resource ID: 94cf2407-eea6-443c-843d-93034322bf97 with Priority: HIGHEST for action port [ 1138.317272] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1138.321540] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1138.321540] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cf2407-eea6-443c-843d-93034322bf97 with Priority: HIGHEST for action port [ 1138.321540] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.321540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.321540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.321540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.321540] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.323803] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.324942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.324942] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-94cf2407-eea6-443c-843d-93034322bf97 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.324942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.324942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.324942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.324942] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94cf2407-eea6-443c-843d-93034322bf97',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.823186] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.823508] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.827794] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94cf2407-eea6-443c-843d-93034322bf97 with status ACTIVE [ 1138.828043] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.828180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.828253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.828499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.828605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.828789] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.828891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.828955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.829131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.829211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.829402] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.829501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.829550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.829737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.829817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.829906] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94cf2407-eea6-443c-843d-93034322bf97 is going to be updated. [ 1138.851209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.851405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.851441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.851670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.851818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.851993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.149628] env[69777]: INFO networking_nsxv3.common.synchronization [req-3987a2d0-19f2-4bdd-aa5d-f69c384e6bb3 req-c7a2a1dd-9404-42a5-8c6d-35291d45d0e6 tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1139.150316] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1139.150651] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.150899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.150899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.150999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.151111] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.151214] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.151276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.151468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.151605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.151658] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.613540] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1139.613788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.653475] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.653638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.653712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.653968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.672513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.672833] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.672982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.673095] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.673454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.673454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.673454] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1139.697075] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.697231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.697355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.697514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.697656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.705105] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1140.013618] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1140.014056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.014056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.014252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.014447] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.014568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.014637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.014796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.014898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.014973] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.517434] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.019545] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.134410] env[69777]: INFO networking_nsxv3.common.synchronization [req-0fba3c05-a9bb-4602-9719-5f32170c7faf req-40b30315-2f31-481b-a561-71c66415c496 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 1141.134976] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 1141.135333] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.135506] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.135624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.135810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.135972] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.136157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.136157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.136364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.136496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.136650] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.442040] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.442309] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.442456] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.442751] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.447108] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.447329] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.447463] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.447708] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.447858] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.448086] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.448204] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.448383] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.448552] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.448685] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.448797] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.448937] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.471309] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.471572] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1141.471738] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.471994] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.472380] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.472584] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.472718] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.473118] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.473299] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d29e36b1-32f5-4fc3-b04a-3bf13f5303f9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.521936] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.522170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.522170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.522381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.522488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.522589] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1141.550191] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.550350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.550421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.550610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.550755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.561885] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1141.639725] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.639872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.639947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.640209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.660962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.660962] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.660962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.660962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.661162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.661162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.661230] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 is going to be updated. [ 1141.685014] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.685257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.685257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.685618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.685618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.694149] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: IN_PROGRESS for 2s [ 1141.711787] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1141.711969] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 1141.712097] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.979865] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.979983] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.980117] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.980423] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.980642] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.980799] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 not found, creating... [ 1141.981068] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.981239] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.981367] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.981661] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.981816] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.982157] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.982339] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.982574] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.982815] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.982906] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.983104] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 is going to be created. [ 1142.004240] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.004511] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.004608] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.004888] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.005180] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.005359] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.769708] env[69777]: INFO networking_nsxv3.common.synchronization [req-0fba3c05-a9bb-4602-9719-5f32170c7faf req-6362730c-9725-49ac-afdb-7a247d41a4b9 service nova] Enqueued Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_rules [ 1142.769708] env[69777]: INFO networking_nsxv3.common.synchronization [req-0fba3c05-a9bb-4602-9719-5f32170c7faf req-6362730c-9725-49ac-afdb-7a247d41a4b9 service nova] Enqueued Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 1142.769708] env[69777]: INFO networking_nsxv3.common.synchronization [req-0fba3c05-a9bb-4602-9719-5f32170c7faf req-6362730c-9725-49ac-afdb-7a247d41a4b9 service nova] Enqueued Resource ID: d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 with Priority: HIGHEST for action port [ 1142.774029] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_rules [ 1142.774029] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 1142.774029] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 with Priority: HIGHEST for action port [ 1142.774029] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.774029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.774029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.774029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.774029] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.774029] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.774029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.774029] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.774029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.774029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.774029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.774029] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d29e36b1-32f5-4fc3-b04a-3bf13f5303f9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.276601] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.277331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.277331] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 with status ACTIVE [ 1143.277331] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.277331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.277331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.278492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.278492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.278492] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.278492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.278492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.278492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.278492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.278771] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.278771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.278771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.278867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.278942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.279054] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 is going to be updated. [ 1143.300038] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.300038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.300234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.300779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.300779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.300864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.571710] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1143.571962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.572183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.572432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.572672] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.572804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.572869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.573064] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.573183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.573386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.573494] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.612719] env[69777]: INFO networking_nsxv3.common.synchronization [req-fc12f75f-d123-47de-ae6d-29e9010f836c req-f3394cf5-beda-4d78-ae9c-d53e198cf4cb tempest-ServersNegativeTestJSON-1844530137 tempest-ServersNegativeTestJSON-1844530137-project-member] Enqueued Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 1143.613236] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0519206-80b2-42a4-bf40-fb2cb2292017 with Priority: HIGHEST for action security_group_members [ 1143.613538] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0519206-80b2-42a4-bf40-fb2cb2292017 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.613657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.613726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.613920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.614093] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.614192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.614255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.614401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.614486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.614579] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0519206-80b2-42a4-bf40-fb2cb2292017',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.710233] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: IN_PROGRESS for 4s [ 1144.077024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.077024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.078378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.078378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.078378] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.078378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.081095] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.081380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.081559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.081680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.081872] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.081987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.082069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.082248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.082395] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.082794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.082894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.083115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.083240] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.083367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.083487] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.116425] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.116588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.116629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.116837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.137417] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.137832] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.138199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.138320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.138693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.138693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.138878] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 is going to be updated. [ 1144.165476] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.165641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.165728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.165954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.166220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.175641] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: IN_PROGRESS for 2s [ 1144.586275] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6831ceb6-9d33-4058-9454-2d8e13eb4e86: rpc.has_security_group_logging(os_id): False [ 1144.604142] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.604339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.604371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.604608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.604706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.604942] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.605060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.605119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.605294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.605388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.605574] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.605659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.605758] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.605886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.605951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.606700] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.606823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.606939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.607493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.607493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.607493] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1144.661569] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.661728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.661864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.662152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.662300] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.674937] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1145.719918] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: SUCCESS [ 1145.719918] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 deletion is rescheduled due to dependency. [ 1145.719918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.719918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.720417] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.720417] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.720417] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.720558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.721048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.721048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.721048] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.187371] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0519206-80b2-42a4-bf40-fb2cb2292017 in Status: SUCCESS [ 1146.188124] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0519206-80b2-42a4-bf40-fb2cb2292017 deletion is rescheduled due to dependency. [ 1146.188478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0519206-80b2-42a4-bf40-fb2cb2292017" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.224225] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.689210] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1146.689437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.726555] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.228680] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.228680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.228680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.228874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.228874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.228939] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 is going to be updated. [ 1147.255639] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.255801] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.255851] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.256104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.256649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.264052] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: IN_PROGRESS for 2s [ 1148.167743] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab56f58e-6b2c-44a5-ba7c-99e93ed27738 req-2b1bba6e-1a0e-4c8a-9428-4e7da3a3c369 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_members [ 1148.168093] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab56f58e-6b2c-44a5-ba7c-99e93ed27738 req-2b1bba6e-1a0e-4c8a-9428-4e7da3a3c369 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1148.168532] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_members [ 1148.168682] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1148.169012] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc72db9c-8353-46bd-b144-5a9b38f5df0a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.169338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.169338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.169709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.170962] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.170962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.170962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.170962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.170962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.170962] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.172037] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.172037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.172037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.172849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.172849] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.172849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.172849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.172849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.172849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.173094] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.218292] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab56f58e-6b2c-44a5-ba7c-99e93ed27738 req-2b1bba6e-1a0e-4c8a-9428-4e7da3a3c369 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1148.218661] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab56f58e-6b2c-44a5-ba7c-99e93ed27738 req-2b1bba6e-1a0e-4c8a-9428-4e7da3a3c369 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1148.219165] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab56f58e-6b2c-44a5-ba7c-99e93ed27738 req-2b1bba6e-1a0e-4c8a-9428-4e7da3a3c369 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_rules [ 1148.219333] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab56f58e-6b2c-44a5-ba7c-99e93ed27738 req-2b1bba6e-1a0e-4c8a-9428-4e7da3a3c369 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_members [ 1148.219526] env[69777]: INFO networking_nsxv3.common.synchronization [req-ab56f58e-6b2c-44a5-ba7c-99e93ed27738 req-2b1bba6e-1a0e-4c8a-9428-4e7da3a3c369 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 94cf2407-eea6-443c-843d-93034322bf97 with Priority: HIGHEST for action port [ 1148.219937] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1148.220348] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_rules [ 1148.220523] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cf2407-eea6-443c-843d-93034322bf97 with Priority: HIGHEST for action port [ 1148.220669] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1148.220837] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_members [ 1148.221329] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.221509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.221655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.221882] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.222009] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.222933] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc72db9c-8353-46bd-b144-5a9b38f5df0a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.224073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.224162] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.224390] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.224472] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.227296] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-94cf2407-eea6-443c-843d-93034322bf97 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.227296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.227296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.227296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.227296] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94cf2407-eea6-443c-843d-93034322bf97',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.227296] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.227296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.227296] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc72db9c-8353-46bd-b144-5a9b38f5df0a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.227296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.674810] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.675793] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.728287] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.728495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.731058] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc72db9c-8353-46bd-b144-5a9b38f5df0a taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.731058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.731058] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94cf2407-eea6-443c-843d-93034322bf97 with status ACTIVE [ 1148.731058] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.731058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.731058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.731058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.731058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.731058] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.731058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.731058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.731058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.731058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.731058] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.731676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.731676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.731676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.731676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.731676] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94cf2407-eea6-443c-843d-93034322bf97 is going to be updated. [ 1148.753780] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.753951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.753996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.754164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.754296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.754451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.177703] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.179131] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.275399] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: SUCCESS [ 1149.275759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.275991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.276308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.276582] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.276772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.276887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.277142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.277284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.277426] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.277560] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.653603] env[69777]: INFO networking_nsxv3.common.synchronization [req-e46ecc09-b805-4611-abcc-20de4cc38698 req-bfe5f120-580d-4aef-b51b-98a2ea932a97 tempest-ImagesOneServerTestJSON-1932271102 tempest-ImagesOneServerTestJSON-1932271102-project-member] Enqueued Resource ID: dfaae587-8793-4f50-bc13-dd477aa227cd with Priority: HIGHEST for action security_group_members [ 1149.654208] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfaae587-8793-4f50-bc13-dd477aa227cd with Priority: HIGHEST for action security_group_members [ 1149.654559] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfaae587-8793-4f50-bc13-dd477aa227cd taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.656032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.656032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.656032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.656032] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.656032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.656032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.656032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.656032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.656032] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfaae587-8793-4f50-bc13-dd477aa227cd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.681209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.681209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.681209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.681331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.681331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.681469] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a is going to be created. [ 1149.682704] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.682830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.682903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.683056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.683141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.683228] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1149.708385] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.708503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.708578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.708797] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.708960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.711521] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.711721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.711990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.712314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.712314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.720451] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a in Status: UNINITIALIZED for 2s [ 1149.721547] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1149.780827] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.781041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.781167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.781404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.781599] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.781706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.781772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.781927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.782038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.782132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.782280] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.782373] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.782434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.782573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.782797] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.782936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.783011] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.783183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.783267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.783351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.783440] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.961202] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.961408] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-162" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.961521] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-162" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.961921] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-162" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.962200] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.962382] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.962496] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.962723] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.962926] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.963177] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.963298] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.963411] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.963525] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.963644] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.963749] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.963884] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.981219] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.981382] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1149.981543] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.982153] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-162" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.982153] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-6b7cfec7-c5ce-4152-ae21-bae36fda250b taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.982388] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-6b7cfec7-c5ce-4152-ae21-bae36fda250b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.982388] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-6b7cfec7-c5ce-4152-ae21-bae36fda250b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.982645] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-6b7cfec7-c5ce-4152-ae21-bae36fda250b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.982788] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b7cfec7-c5ce-4152-ae21-bae36fda250b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.158660] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.158943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.159073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.159326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.159427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.159726] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.159860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.159929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.160123] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.160742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.160742] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfaae587-8793-4f50-bc13-dd477aa227cd already deleted. [ 1150.160742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.285892] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfc00e54-a878-499a-acb4-f2b1c4844df7: rpc.has_security_group_logging(os_id): False [ 1150.302923] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.303112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.303213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.303344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.303432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.303678] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.303790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.303859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.304025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.304108] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.304292] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.304393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.304444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.304619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.304672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.304816] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.304907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.304971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.305126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.305202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.305288] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 is going to be updated. [ 1150.435719] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.435883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.435947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.436189] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.436337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.447490] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: IN_PROGRESS for 2s [ 1150.485811] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.486049] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.486209] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.486528] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.486697] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.486873] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 6b7cfec7-c5ce-4152-ae21-bae36fda250b not found, creating... [ 1150.487168] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.487331] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.487453] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.487679] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.487824] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.488186] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.488356] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.488579] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.488826] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.488970] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.489130] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 6b7cfec7-c5ce-4152-ae21-bae36fda250b is going to be created. [ 1150.513292] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.513628] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.513628] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.513903] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.514147] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.514655] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-6b7cfec7-c5ce-4152-ae21-bae36fda250b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.103044] env[69777]: INFO networking_nsxv3.common.synchronization [req-ee9686fb-70cd-446a-8e9e-532df49bca15 req-1ceadfb7-bb09-45f8-9e5f-e797d66985e2 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 1151.103699] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 with Priority: HIGHEST for action security_group_members [ 1151.104063] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfc00e54-a878-499a-acb4-f2b1c4844df7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.104199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.104292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.104521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.104741] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.104859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.104923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.105150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.105241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.105299] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfc00e54-a878-499a-acb4-f2b1c4844df7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.187651] env[69777]: INFO networking_nsxv3.common.synchronization [req-ee9686fb-70cd-446a-8e9e-532df49bca15 req-1ceadfb7-bb09-45f8-9e5f-e797d66985e2 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 with Priority: HIGHEST for action port [ 1151.189308] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 with Priority: HIGHEST for action port [ 1151.189308] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.189308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.189308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.189308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.189308] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d29e36b1-32f5-4fc3-b04a-3bf13f5303f9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.357194] env[69777]: INFO networking_nsxv3.common.synchronization [req-e46ecc09-b805-4611-abcc-20de4cc38698 req-77f49dbc-4e11-4cc9-91cc-7d4621a3633a service nova] Enqueued Resource ID: dfaae587-8793-4f50-bc13-dd477aa227cd with Priority: HIGHEST for action security_group_rules [ 1151.357194] env[69777]: INFO networking_nsxv3.common.synchronization [req-e46ecc09-b805-4611-abcc-20de4cc38698 req-77f49dbc-4e11-4cc9-91cc-7d4621a3633a service nova] Enqueued Resource ID: dfaae587-8793-4f50-bc13-dd477aa227cd with Priority: HIGHEST for action security_group_members [ 1151.357194] env[69777]: INFO networking_nsxv3.common.synchronization [req-e46ecc09-b805-4611-abcc-20de4cc38698 req-77f49dbc-4e11-4cc9-91cc-7d4621a3633a service nova] Enqueued Resource ID: 6b7cfec7-c5ce-4152-ae21-bae36fda250b with Priority: HIGHEST for action port [ 1151.357194] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfaae587-8793-4f50-bc13-dd477aa227cd with Priority: HIGHEST for action security_group_rules [ 1151.357194] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfaae587-8793-4f50-bc13-dd477aa227cd with Priority: HIGHEST for action security_group_members [ 1151.357194] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b7cfec7-c5ce-4152-ae21-bae36fda250b with Priority: HIGHEST for action port [ 1151.357194] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfaae587-8793-4f50-bc13-dd477aa227cd taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.357194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.357756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.357863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.358357] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfaae587-8793-4f50-bc13-dd477aa227cd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.359741] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfaae587-8793-4f50-bc13-dd477aa227cd taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.359863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.359938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.360147] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.360299] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.360395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.360464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.360631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.360730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.360890] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfaae587-8793-4f50-bc13-dd477aa227cd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.361582] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b7cfec7-c5ce-4152-ae21-bae36fda250b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.361698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b7cfec7-c5ce-4152-ae21-bae36fda250b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.361764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b7cfec7-c5ce-4152-ae21-bae36fda250b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.361916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b7cfec7-c5ce-4152-ae21-bae36fda250b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.361999] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b7cfec7-c5ce-4152-ae21-bae36fda250b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.607698] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.607857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.607931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.608185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.608281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.608500] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.608610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.608676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.608832] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.608911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.608999] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 is going to be updated. [ 1151.633396] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.633578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.633629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.633805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.633945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.641494] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: IN_PROGRESS for 2s [ 1151.690999] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 with status ACTIVE [ 1151.691272] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.691408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.691482] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.691739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.691853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.692078] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.692205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.692300] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.692496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.692596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.692823] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.693100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.693658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.693658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.693658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.693658] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d29e36b1-32f5-4fc3-b04a-3bf13f5303f9 is going to be updated. [ 1151.719070] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.719217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.719287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.719490] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.719620] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.719775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d29e36b1-32f5-4fc3-b04a-3bf13f5303f9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.731369] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a in Status: SUCCESS [ 1151.731612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.731796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.732010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.732195] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.732417] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.732497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.733200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.733200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.733200] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.734317] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1151.734491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.734637] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.734802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.734976] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.735107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.735148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.735262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.735336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.735425] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.860130] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfaae587-8793-4f50-bc13-dd477aa227cd taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.860305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.864026] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b7cfec7-c5ce-4152-ae21-bae36fda250b with status ACTIVE [ 1151.864026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.864026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.864220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.864288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.864380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.864555] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.864656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.864712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.864899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.864982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.865227] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.865325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.865388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.865533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.865609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.865692] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b7cfec7-c5ce-4152-ae21-bae36fda250b is going to be updated. [ 1151.866759] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfaae587-8793-4f50-bc13-dd477aa227cd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.889514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.889514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.889514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.889711] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.889711] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.889944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b7cfec7-c5ce-4152-ae21-bae36fda250b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.237032] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.238036] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.371200] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfaae587-8793-4f50-bc13-dd477aa227cd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.459712] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: SUCCESS [ 1152.459936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.740323] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.741374] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.874028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.874028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.874028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.874028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.874316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.875145] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfaae587-8793-4f50-bc13-dd477aa227cd is going to be created. [ 1152.897550] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.897714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.897753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.897961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.898137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.906465] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfaae587-8793-4f50-bc13-dd477aa227cd in Status: UNINITIALIZED for 2s [ 1153.243864] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.244126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.244200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.244924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.244924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.244924] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1153.245967] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.246098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.246098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.246253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.246335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.246424] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a is going to be updated. [ 1153.272899] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.272986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.273041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.273230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.273375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.275129] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.275260] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.275325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.275491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.275615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.283864] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1153.284524] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a in Status: IN_PROGRESS for 2s [ 1153.652419] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 in Status: SUCCESS [ 1153.652772] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfc00e54-a878-499a-acb4-f2b1c4844df7 deletion is rescheduled due to dependency. [ 1153.652772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfc00e54-a878-499a-acb4-f2b1c4844df7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.362381] env[69777]: INFO networking_nsxv3.common.synchronization [req-07d90318-c29b-49c3-aacf-dda412bee120 req-8b4256c7-ca97-47db-8518-5dcb4cfe8177 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1154.362931] env[69777]: INFO networking_nsxv3.common.synchronization [req-07d90318-c29b-49c3-aacf-dda412bee120 req-8b4256c7-ca97-47db-8518-5dcb4cfe8177 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_members [ 1154.363475] env[69777]: INFO networking_nsxv3.common.synchronization [req-07d90318-c29b-49c3-aacf-dda412bee120 req-8b4256c7-ca97-47db-8518-5dcb4cfe8177 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 583c12ed-43be-46ce-8384-a2386c353f44 with Priority: HIGHEST for action security_group_members [ 1154.364654] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1154.365051] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_members [ 1154.365497] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583c12ed-43be-46ce-8384-a2386c353f44 with Priority: HIGHEST for action security_group_members [ 1154.366030] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.366181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.366535] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc72db9c-8353-46bd-b144-5a9b38f5df0a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.366748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.367095] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-583c12ed-43be-46ce-8384-a2386c353f44 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.367286] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.367400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.367863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.368166] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.368423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.368484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.369450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.369450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.369450] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583c12ed-43be-46ce-8384-a2386c353f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.418044] env[69777]: INFO networking_nsxv3.common.synchronization [req-07d90318-c29b-49c3-aacf-dda412bee120 req-8b4256c7-ca97-47db-8518-5dcb4cfe8177 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 583c12ed-43be-46ce-8384-a2386c353f44 with Priority: HIGHEST for action security_group_rules [ 1154.418269] env[69777]: INFO networking_nsxv3.common.synchronization [req-07d90318-c29b-49c3-aacf-dda412bee120 req-8b4256c7-ca97-47db-8518-5dcb4cfe8177 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 583c12ed-43be-46ce-8384-a2386c353f44 with Priority: HIGHEST for action security_group_members [ 1154.418513] env[69777]: INFO networking_nsxv3.common.synchronization [req-07d90318-c29b-49c3-aacf-dda412bee120 req-8b4256c7-ca97-47db-8518-5dcb4cfe8177 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1154.418746] env[69777]: INFO networking_nsxv3.common.synchronization [req-07d90318-c29b-49c3-aacf-dda412bee120 req-8b4256c7-ca97-47db-8518-5dcb4cfe8177 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1154.418987] env[69777]: INFO networking_nsxv3.common.synchronization [req-07d90318-c29b-49c3-aacf-dda412bee120 req-8b4256c7-ca97-47db-8518-5dcb4cfe8177 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_rules [ 1154.419238] env[69777]: INFO networking_nsxv3.common.synchronization [req-07d90318-c29b-49c3-aacf-dda412bee120 req-8b4256c7-ca97-47db-8518-5dcb4cfe8177 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_members [ 1154.421039] env[69777]: INFO networking_nsxv3.common.synchronization [req-07d90318-c29b-49c3-aacf-dda412bee120 req-8b4256c7-ca97-47db-8518-5dcb4cfe8177 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 94cf2407-eea6-443c-843d-93034322bf97 with Priority: HIGHEST for action port [ 1154.421039] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583c12ed-43be-46ce-8384-a2386c353f44 with Priority: HIGHEST for action security_group_rules [ 1154.421039] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_rules [ 1154.421039] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_members [ 1154.421039] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cf2407-eea6-443c-843d-93034322bf97 with Priority: HIGHEST for action port [ 1154.421039] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_rules [ 1154.421478] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583c12ed-43be-46ce-8384-a2386c353f44 with Priority: HIGHEST for action security_group_members [ 1154.421478] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1154.421716] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-583c12ed-43be-46ce-8384-a2386c353f44 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.421917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.422032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.422433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.422564] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('583c12ed-43be-46ce-8384-a2386c353f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.424401] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.424493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.424958] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc72db9c-8353-46bd-b144-5a9b38f5df0a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.425161] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.425414] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-94cf2407-eea6-443c-843d-93034322bf97 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.425608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.425935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.426260] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.426386] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94cf2407-eea6-443c-843d-93034322bf97',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.428146] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc72db9c-8353-46bd-b144-5a9b38f5df0a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.428292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.428590] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-583c12ed-43be-46ce-8384-a2386c353f44 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.428736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.429047] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.429188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.873842] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('583c12ed-43be-46ce-8384-a2386c353f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.915707] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfaae587-8793-4f50-bc13-dd477aa227cd in Status: SUCCESS [ 1154.915949] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.916143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.916410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.916603] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.916844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.916844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.917082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.917173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.917284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.917373] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfaae587-8793-4f50-bc13-dd477aa227cd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.929484] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94cf2407-eea6-443c-843d-93034322bf97 with status ACTIVE [ 1154.929703] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.929833] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.929908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.930220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.930322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.930509] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.930693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.930777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.930976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.931096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.931318] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.931450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.931524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.931745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.931856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.931973] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94cf2407-eea6-443c-843d-93034322bf97 is going to be updated. [ 1154.933286] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-583c12ed-43be-46ce-8384-a2386c353f44 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.933383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.950997] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.951195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.951257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.951432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.951591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.951748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94cf2407-eea6-443c-843d-93034322bf97" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.295715] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1155.295981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.296310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.296714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.296914] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.297052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.297112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.297394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.297480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.297571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.297671] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.300170] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a in Status: SUCCESS [ 1155.300352] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.300504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.300701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.300877] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.301102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.301102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.301212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.301306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.301359] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.302170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.302385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.306217] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.306217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.306217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.306217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.306217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.306217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.306217] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.307135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.307205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.307411] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.307527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.307603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.308473] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.308588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.308645] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.377182] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('583c12ed-43be-46ce-8384-a2386c353f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.419853] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfaae587-8793-4f50-bc13-dd477aa227cd taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.420103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.420103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.420431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.420722] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.420869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.420961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.421178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.421284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.421379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.421571] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfaae587-8793-4f50-bc13-dd477aa227cd taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.421698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.421767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.421921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.422091] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.422192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.422262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.422441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.422548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.422640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.422733] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfaae587-8793-4f50-bc13-dd477aa227cd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.808154] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.809263] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.809368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.809716] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.810410] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.879865] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.879865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.879865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.880306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.880306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.880306] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583c12ed-43be-46ce-8384-a2386c353f44 is going to be created. [ 1155.908515] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.908830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.908968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.909256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.909605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.920313] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583c12ed-43be-46ce-8384-a2386c353f44 in Status: UNINITIALIZED for 2s [ 1155.925092] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfaae587-8793-4f50-bc13-dd477aa227cd: rpc.has_security_group_logging(os_id): False [ 1155.942314] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.942553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.942553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.942779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.942838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.943186] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.943306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.943372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.943589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.943673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.943860] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.943954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.944070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.944212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.944273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.944570] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.944697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.944756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.944973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.945091] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.945295] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfaae587-8793-4f50-bc13-dd477aa227cd is going to be created. [ 1156.005971] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.006166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.006238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.006467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.006821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.017915] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfaae587-8793-4f50-bc13-dd477aa227cd in Status: IN_PROGRESS for 2s [ 1156.311420] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.315127] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc72db9c-8353-46bd-b144-5a9b38f5df0a: rpc.has_security_group_logging(os_id): False [ 1156.316063] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.332360] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.332360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.332360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.332523] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.332645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.332820] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.332921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.332971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.333129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.333207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.333291] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a is going to be created. [ 1156.381326] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.381488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.381531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.381871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.382067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.391727] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a in Status: IN_PROGRESS for 2s [ 1156.814592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.814795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.814867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.815120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.815231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.815310] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1156.817851] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.817978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.818058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.818243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.818331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.818423] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a is going to be updated. [ 1156.857489] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.857675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.857675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.857822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.857971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.859808] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.859955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.860041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.860249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.860384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.869832] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1156.870395] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a in Status: IN_PROGRESS for 2s [ 1157.087848] env[69777]: INFO networking_nsxv3.common.synchronization [req-79eb8ad6-2e8c-41a9-b37a-2570bf1cd375 req-9e0e4b66-4e8a-4ad2-b4d1-155436182a69 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_members [ 1157.087848] env[69777]: INFO networking_nsxv3.common.synchronization [req-79eb8ad6-2e8c-41a9-b37a-2570bf1cd375 req-9e0e4b66-4e8a-4ad2-b4d1-155436182a69 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1157.087848] env[69777]: INFO networking_nsxv3.common.synchronization [req-79eb8ad6-2e8c-41a9-b37a-2570bf1cd375 req-9e0e4b66-4e8a-4ad2-b4d1-155436182a69 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 583c12ed-43be-46ce-8384-a2386c353f44 with Priority: HIGHEST for action security_group_members [ 1157.087848] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a with Priority: HIGHEST for action security_group_members [ 1157.087848] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1157.087848] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583c12ed-43be-46ce-8384-a2386c353f44 with Priority: HIGHEST for action security_group_members [ 1157.087848] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc72db9c-8353-46bd-b144-5a9b38f5df0a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.087848] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.087848] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.087848] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.087848] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-583c12ed-43be-46ce-8384-a2386c353f44 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.087848] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.199672] env[69777]: INFO networking_nsxv3.common.synchronization [req-1521ce7a-a328-435b-a256-79a9727b0d9a req-05d81d8c-34a8-4426-9d97-a87324c31291 tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1157.199672] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1157.199913] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.200059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.200129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.200335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.200489] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.200655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.200724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.200873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.200958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.201064] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.550692] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.550918] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.551059] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.551326] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.551597] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.551766] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.551870] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.552096] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.552244] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.552458] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.552578] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.552694] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.552806] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.552920] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.553063] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.553175] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.576138] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.576310] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1157.576451] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.576618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.576900] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-8b906f30-c1c7-4f36-9c7a-26317a31150a taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.577081] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-8b906f30-c1c7-4f36-9c7a-26317a31150a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.577208] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-8b906f30-c1c7-4f36-9c7a-26317a31150a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.577503] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-8b906f30-c1c7-4f36-9c7a-26317a31150a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.577704] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b906f30-c1c7-4f36-9c7a-26317a31150a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.703388] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.703547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.703623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.703845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.703938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.704145] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.704243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.704307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.704450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.704525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.704700] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1157.728075] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.728219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.728289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.728476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.728672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.737359] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1157.930510] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 583c12ed-43be-46ce-8384-a2386c353f44 in Status: SUCCESS [ 1157.930925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.931156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.931400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.931633] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.931761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.931896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.932017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.932130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.932240] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583c12ed-43be-46ce-8384-a2386c353f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.027992] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfaae587-8793-4f50-bc13-dd477aa227cd in Status: SUCCESS [ 1158.028217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.080258] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.080576] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.080679] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.081105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.081291] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.081461] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 8b906f30-c1c7-4f36-9c7a-26317a31150a not found, creating... [ 1158.081849] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.082086] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.082224] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.082467] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.082617] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.082913] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.083100] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.083217] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.083451] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.083593] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.083741] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 8b906f30-c1c7-4f36-9c7a-26317a31150a is going to be created. [ 1158.110643] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.110966] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.111076] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.111353] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.111595] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.111844] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-8b906f30-c1c7-4f36-9c7a-26317a31150a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.405338] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a in Status: SUCCESS [ 1158.405577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.405763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.405983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.406086] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.435997] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.435997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.435997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.435997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.435997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.435997] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.435997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.435997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.436429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.436429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.436429] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583c12ed-43be-46ce-8384-a2386c353f44 is going to be deleted. [ 1158.464628] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.464774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.464845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.465064] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.465157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.465256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.465406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.465553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.465714] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.465815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.465876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.466019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.466098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.466190] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583c12ed-43be-46ce-8384-a2386c353f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.766008] env[69777]: INFO networking_nsxv3.common.synchronization [req-1521ce7a-a328-435b-a256-79a9727b0d9a req-f9dd8ef5-d15e-44f7-9e0b-061adbe8e48a service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 1158.766218] env[69777]: INFO networking_nsxv3.common.synchronization [req-1521ce7a-a328-435b-a256-79a9727b0d9a req-f9dd8ef5-d15e-44f7-9e0b-061adbe8e48a service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1158.766364] env[69777]: INFO networking_nsxv3.common.synchronization [req-1521ce7a-a328-435b-a256-79a9727b0d9a req-f9dd8ef5-d15e-44f7-9e0b-061adbe8e48a service nova] Enqueued Resource ID: 8b906f30-c1c7-4f36-9c7a-26317a31150a with Priority: HIGHEST for action port [ 1158.766595] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 1158.766718] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1158.766827] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b906f30-c1c7-4f36-9c7a-26317a31150a with Priority: HIGHEST for action port [ 1158.767424] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.767561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.767617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.767807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.767878] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.768724] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.768823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.769014] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b906f30-c1c7-4f36-9c7a-26317a31150a taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.769116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b906f30-c1c7-4f36-9c7a-26317a31150a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.769179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b906f30-c1c7-4f36-9c7a-26317a31150a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.769340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b906f30-c1c7-4f36-9c7a-26317a31150a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.769411] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b906f30-c1c7-4f36-9c7a-26317a31150a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.880986] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a in Status: SUCCESS [ 1158.881216] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.881373] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.881614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.881780] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.881894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.881958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.882120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.882200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.882297] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.883720] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1158.883901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.884078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.884256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.884419] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.884524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.884588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.884732] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.884806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.884894] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.929634] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.929844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.929919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.930155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.930248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.930347] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a is going to be deleted. [ 1158.967984] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.968119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.968190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.968412] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.968583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.968787] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.968890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.968954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.969122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.969200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.969286] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583c12ed-43be-46ce-8384-a2386c353f44 already deleted. [ 1158.969365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.969480] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('583c12ed-43be-46ce-8384-a2386c353f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.970318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.970488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.970689] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.970792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.970859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.971015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.971099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.971184] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('583c12ed-43be-46ce-8384-a2386c353f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.983516] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.983726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.983726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.983897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.983988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.984110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.271349] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.271734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.273947] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b906f30-c1c7-4f36-9c7a-26317a31150a with status ACTIVE [ 1159.274182] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.274314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.274384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.274600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.274974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.274974] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.274974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.275128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.275200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.275276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.275478] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.275573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.275636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.275816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.275920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.275979] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b906f30-c1c7-4f36-9c7a-26317a31150a is going to be updated. [ 1159.299654] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.299654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.299654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.299654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.299654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.300386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b906f30-c1c7-4f36-9c7a-26317a31150a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.386980] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.387281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.387281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.387540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.387605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.387809] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.387914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.387980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.388159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.388530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.388530] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a is going to be deleted. [ 1159.389410] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.431048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.431236] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.431322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.431662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.431818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.431929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.432146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.432369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.432573] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.432682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.432742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.432948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.436545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.436778] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc72db9c-8353-46bd-b144-5a9b38f5df0a',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.472511] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('583c12ed-43be-46ce-8384-a2386c353f44',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.473616] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.473789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.473827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.474032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.474127] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.474353] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.474487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.474569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.474792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.474920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.475065] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 583c12ed-43be-46ce-8384-a2386c353f44 already deleted. [ 1159.475167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.750282] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1159.750282] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 1159.750282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.750282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.750282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.750282] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.750282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.750282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.750282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.750282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.750282] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.893688] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.939454] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.939454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.939454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.939690] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.942433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.942677] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.942810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.942877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.943078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.943182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.943296] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc72db9c-8353-46bd-b144-5a9b38f5df0a already deleted. [ 1159.943385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc72db9c-8353-46bd-b144-5a9b38f5df0a" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.976502] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 583c12ed-43be-46ce-8384-a2386c353f44: rpc.has_security_group_logging(os_id): False [ 1159.993247] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.993440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.993440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.993652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.993744] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.993963] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.994076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.994141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.994298] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.994366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.994452] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583c12ed-43be-46ce-8384-a2386c353f44 is going to be created. [ 1160.012960] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/583c12ed-43be-46ce-8384-a2386c353f44], does not exist path=[/infra/domains/default/groups/583c12ed-43be-46ce-8384-a2386c353f44]."\n}' [ 1160.013151] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583c12ed-43be-46ce-8384-a2386c353f44 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/583c12ed-43be-46ce-8384-a2386c353f44 [ 1160.013209] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1160.046287] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.046287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.046287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.046287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.046287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.046287] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.046287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.046287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.046633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.046633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.046767] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.046853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.046936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.047088] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.047161] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.047246] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 583c12ed-43be-46ce-8384-a2386c353f44 is going to be created. [ 1160.067935] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/583c12ed-43be-46ce-8384-a2386c353f44], does not exist path=[/infra/domains/default/groups/583c12ed-43be-46ce-8384-a2386c353f44]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/583c12ed-43be-46ce-8384-a2386c353f44 [ 1160.068137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-583c12ed-43be-46ce-8384-a2386c353f44" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.068775] env[69777]: Traceback (most recent call last): [ 1160.068889] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1160.068889] env[69777]: return func(*args, **kwargs) [ 1160.068889] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1160.068889] env[69777]: res.raise_for_status() [ 1160.068889] env[69777]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1160.068889] env[69777]: raise HTTPError(http_error_msg, response=self) [ 1160.068889] env[69777]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/583c12ed-43be-46ce-8384-a2386c353f44 [ 1160.068889] env[69777]: During handling of the above exception, another exception occurred: [ 1160.068889] env[69777]: Traceback (most recent call last): [ 1160.068889] env[69777]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1160.068889] env[69777]: listener.cb(fileno) [ 1160.068889] env[69777]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1160.068889] env[69777]: result = function(*args, **kwargs) [ 1160.068889] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1160.068889] env[69777]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1160.068889] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1160.068889] env[69777]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1160.068889] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1160.068889] env[69777]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1160.068889] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1160.068889] env[69777]: res.raise_for_status() [ 1160.068889] env[69777]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1160.068889] env[69777]: raise HTTPError(http_error_msg, response=self) [ 1160.068889] env[69777]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/583c12ed-43be-46ce-8384-a2386c353f44 [ 1160.068889] env[69777]: Removing descriptor: 75 [ 1160.252985] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.396102] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.396102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.396102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.396102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.396102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.396102] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1160.426048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.426048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.426048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.426315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.426633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.435563] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1160.755743] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.259238] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.259394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.259475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.259696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.259792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.259891] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1161.290041] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.290041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.290041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.290041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.290041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.297893] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1161.503158] env[69777]: INFO networking_nsxv3.common.synchronization [req-e848d414-eb7d-44c4-b4bf-69130905f19a req-8f17dabe-e753-4ac6-adf2-30ecd355cd9b tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1161.503632] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1161.503632] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.503717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.505072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.505072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.505072] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.505072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.505072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.505072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.505072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.505072] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.927408] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.927730] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.927908] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.928244] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.928590] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.928910] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.929055] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.929300] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.929460] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.929678] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.929809] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.929939] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.930098] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.930238] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.930353] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.930497] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.951027] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.951027] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1161.951027] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.951027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.951027] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-12299ebd-492d-4f0d-9f99-c823e880a9d9 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.951027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-12299ebd-492d-4f0d-9f99-c823e880a9d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.951027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-12299ebd-492d-4f0d-9f99-c823e880a9d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.951027] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-12299ebd-492d-4f0d-9f99-c823e880a9d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.951027] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12299ebd-492d-4f0d-9f99-c823e880a9d9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.008039] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.448626] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1162.448971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.449621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.449786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.449985] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.450289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.450289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.450527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.450527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.450527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.450786] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.450786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.450872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.451064] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.451159] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.451263] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.451323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.451464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.451536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.451774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.451980] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.453563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.453563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.457230] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.457431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.457431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.458049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.458049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.458049] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.459189] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.459363] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.459462] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.459693] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.459929] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.460121] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 12299ebd-492d-4f0d-9f99-c823e880a9d9 not found, creating... [ 1162.460279] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.460462] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.460563] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.462372] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.462372] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.462372] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.462372] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.462372] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.462372] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.462372] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.462372] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 12299ebd-492d-4f0d-9f99-c823e880a9d9 is going to be created. [ 1162.484775] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.485072] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.485149] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.485431] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.485675] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.485988] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-12299ebd-492d-4f0d-9f99-c823e880a9d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.509462] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.742487] env[69777]: INFO networking_nsxv3.common.synchronization [req-d2ac7786-2a92-4bfc-8104-e6211638b7d6 req-4cb6fb51-12a4-41b1-8fd1-ccd563625402 tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_members [ 1162.743383] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGHEST for action security_group_members [ 1162.743843] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f64a4b87-9b99-4306-97e4-e97d2b7d7388 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.743843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.744645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.744645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.744645] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.744645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.744645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.744645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.744645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.744911] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.963887] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6831ceb6-9d33-4058-9454-2d8e13eb4e86: rpc.has_security_group_logging(os_id): False [ 1162.965037] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.984711] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.985029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.985029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.985166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.002331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.002623] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.002748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.002811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.003075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.003170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.003375] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.003474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.003533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.003689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.003766] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.003951] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.004055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.004118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.004253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.004328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.004499] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1163.011457] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.011588] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.011666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.011849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.011934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.012045] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1163.036818] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.037078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.037157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.037564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.037745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.046247] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1163.070543] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.070742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.070820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.071049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.071205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.084741] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1163.185804] env[69777]: INFO networking_nsxv3.common.synchronization [req-e848d414-eb7d-44c4-b4bf-69130905f19a req-c278b453-95bb-4a9e-a845-6ce3eaac021f service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 1163.186061] env[69777]: INFO networking_nsxv3.common.synchronization [req-e848d414-eb7d-44c4-b4bf-69130905f19a req-c278b453-95bb-4a9e-a845-6ce3eaac021f service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1163.186218] env[69777]: INFO networking_nsxv3.common.synchronization [req-e848d414-eb7d-44c4-b4bf-69130905f19a req-c278b453-95bb-4a9e-a845-6ce3eaac021f service nova] Enqueued Resource ID: 12299ebd-492d-4f0d-9f99-c823e880a9d9 with Priority: HIGHEST for action port [ 1163.186784] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 1163.186951] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1163.189213] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12299ebd-492d-4f0d-9f99-c823e880a9d9 with Priority: HIGHEST for action port [ 1163.189590] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.190811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.190908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.191188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.191269] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.192556] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.192658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.193131] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-12299ebd-492d-4f0d-9f99-c823e880a9d9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.193243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12299ebd-492d-4f0d-9f99-c823e880a9d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.193329] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12299ebd-492d-4f0d-9f99-c823e880a9d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.193891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12299ebd-492d-4f0d-9f99-c823e880a9d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.194010] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12299ebd-492d-4f0d-9f99-c823e880a9d9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.249484] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.249640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.249748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.250090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.270539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.270896] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.271087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.271150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.271311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.271394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.271485] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 is going to be updated. [ 1163.296655] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.296808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.296923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.297543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.297543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.306986] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 in Status: IN_PROGRESS for 2s [ 1163.307629] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1163.308452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.308452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.308452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.308452] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.308452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.308696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.308696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.309197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.309197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.309197] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.468198] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.697517] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.697948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.697948] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12299ebd-492d-4f0d-9f99-c823e880a9d9 with status ACTIVE [ 1163.698074] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.698158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.698207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.698422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.698511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.698777] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.698971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.698971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.699135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.699135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.699324] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.699396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.699396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.699529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.699658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.699726] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12299ebd-492d-4f0d-9f99-c823e880a9d9 is going to be updated. [ 1163.729696] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.729696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.729696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.729696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.729696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.729696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12299ebd-492d-4f0d-9f99-c823e880a9d9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.813303] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.813303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.813303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.813449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.813543] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.813628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.813691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.813875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.813995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.814107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.814250] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.814339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.814397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.814534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.814665] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.815463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.815463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.815463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.815463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.815463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.815463] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.970756] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.970937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.971019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.971237] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.971331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.971434] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1164.014540] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.014698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.014767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.014970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.015135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.024878] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1164.317504] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44fd483-f70f-4a69-967b-e48536b42565: rpc.has_security_group_logging(os_id): False [ 1164.336723] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.336944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.337025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.337232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.356236] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.357109] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.357956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.358098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.359251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.359251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.359251] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.359251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.359251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.359251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.359547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.359547] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.359621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.359651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.359789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.359871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.359955] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1164.417295] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.417295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.417295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.417295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.417295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.426241] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1165.056060] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1165.056060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.056513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.056513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.056577] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.056673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.056737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.056973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.057084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.057218] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.099138] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1165.099375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.099988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.100741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.100741] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.316422] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 in Status: SUCCESS [ 1165.316634] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 deletion is rescheduled due to dependency. [ 1165.316722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.559398] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.604124] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.604124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.034779] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1166.035042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.035306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.035580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.035845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.036057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.036165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.036370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.036516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.036659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.036779] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.064254] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.441128] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1166.441353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.539293] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.539488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.539488] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.539721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.539897] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.539996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.540072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.540225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.540308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.540396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.540543] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.540693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.540812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.540904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.541057] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.541150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.541210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.541350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.541443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.541537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.541667] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.566812] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.567015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.567092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.567243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.567336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.567474] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1166.593964] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.594184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.594233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.594435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.594583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.602897] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1167.044136] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6831ceb6-9d33-4058-9454-2d8e13eb4e86: rpc.has_security_group_logging(os_id): False [ 1167.060978] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.061158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.061243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.061512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.061687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.061932] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.063125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.063125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.063125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.063125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.063125] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.063125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.063125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.063125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.063125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.063125] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.063533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.063533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.063533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.063533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.063677] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1167.120187] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.120557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.120557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.120632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.120875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.135550] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1167.240181] env[69777]: INFO networking_nsxv3.common.synchronization [req-d9a6207c-1042-4538-a4ae-5e020f94d82a req-70cde4ef-ae55-4983-807d-2829dc912174 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_members [ 1167.240397] env[69777]: INFO networking_nsxv3.common.synchronization [req-d9a6207c-1042-4538-a4ae-5e020f94d82a req-70cde4ef-ae55-4983-807d-2829dc912174 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1167.240537] env[69777]: INFO networking_nsxv3.common.synchronization [req-d9a6207c-1042-4538-a4ae-5e020f94d82a req-70cde4ef-ae55-4983-807d-2829dc912174 tempest-SecurityGroupsTestJSON-85844639 tempest-SecurityGroupsTestJSON-85844639-project-member] Enqueued Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGHEST for action security_group_members [ 1167.241111] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGHEST for action security_group_members [ 1167.241252] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 with Priority: HIGHEST for action security_group_members [ 1167.241348] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGHEST for action security_group_members [ 1167.241626] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-a246dbb9-bbe3-4f92-8823-3c958f77d63e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.241745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.241808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.242414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.242414] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.242414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.242414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.242642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.242642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.242642] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.243836] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6831ceb6-9d33-4058-9454-2d8e13eb4e86 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.244437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.244437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.244437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.244437] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.244437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.244725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.244725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.244725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.244807] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6831ceb6-9d33-4058-9454-2d8e13eb4e86',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.245545] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-07670245-7199-41ee-bb6c-b1ff49af92c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.245729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.245954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.245954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.246111] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.246187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.246668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.246668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.246668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.246668] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.750139] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.750139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.750139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.750139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.750139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.750139] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.750139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.750139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.750139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.750139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.750139] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 is going to be updated. [ 1167.751207] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.751207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.751207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.751393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.753220] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.753220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.768568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.768837] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.768974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.769173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.769258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.769407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.769455] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e is going to be updated. [ 1167.770418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.770576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.782209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.782391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.782436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.782611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.782751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.792269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.792562] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.792703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.792775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.792999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.793099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.793192] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 is going to be updated. [ 1167.794711] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: IN_PROGRESS for 2s [ 1167.820931] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.821129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.821199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.821355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.821495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.830289] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: IN_PROGRESS for 2s [ 1167.834628] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.834628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.834827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.834900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.834981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.842731] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 in Status: IN_PROGRESS for 2s [ 1168.614761] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1168.615021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.615089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.615337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.615550] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.616089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.616089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.616089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.616089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.616258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.617027] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.118847] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.119082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.119082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.119372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.119618] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.119751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.119839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.120136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.120227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.120356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.120530] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.120712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.120791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.120983] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.121162] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.121404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.121502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.121739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.122086] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.122086] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.122251] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.150304] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1169.150572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.626130] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06bee688-2b64-4a9b-b0eb-ee4c735a9c41: rpc.has_security_group_logging(os_id): False [ 1169.642941] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.643400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.643582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.647770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.665038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.665038] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.665038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.665038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.665038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.665038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.665329] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.665329] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.665398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.665626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.665626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.665849] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.665918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.666611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.666611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.666611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.666611] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1169.726895] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.726895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.726895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.727325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.727325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.739467] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1169.805147] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 in Status: SUCCESS [ 1169.805326] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6831ceb6-9d33-4058-9454-2d8e13eb4e86 deletion is rescheduled due to dependency. [ 1169.805445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6831ceb6-9d33-4058-9454-2d8e13eb4e86" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.841261] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e in Status: SUCCESS [ 1169.841915] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e deletion is rescheduled due to dependency. [ 1169.841915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.851939] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 in Status: SUCCESS [ 1169.852134] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 deletion is rescheduled due to dependency. [ 1169.852245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.565355] env[69777]: INFO networking_nsxv3.common.synchronization [req-c5143580-3653-4b8a-9f55-32cac66e6b3f req-6bca32fa-528e-4250-be46-760d5bea1ec3 tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1170.565355] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1170.565355] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.565355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.566177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.566530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.566828] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.567067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.567219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.567483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.567657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.567852] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.070557] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.070886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.070886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.071169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.089788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.090120] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.090391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.090391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.090575] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.090657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.090792] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 1171.114461] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.114641] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.114776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.114951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.115045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.123198] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 1171.754372] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1171.754665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.043532] env[69777]: INFO networking_nsxv3.common.synchronization [req-b8f44df4-9ab7-4861-bf50-c786e9e77a44 req-1a5f6ce0-995c-4cb6-aed1-69819a39c052 tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1172.043532] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1172.043532] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.043532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.043532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.043532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.043532] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.043532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.043532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.043532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.043532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.043532] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.546288] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.546580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.546580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.546695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.546767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.546962] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.547067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.547124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.547312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.547393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.547483] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1172.575648] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.575844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.575905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.576153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.576298] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.584222] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1173.136351] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 1173.136755] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 deletion is rescheduled due to dependency. [ 1173.137456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.926899] env[69777]: INFO networking_nsxv3.common.synchronization [req-be3c8108-f35d-4635-a921-cea32cfa76a3 req-20d7be89-731f-4e03-b985-c1982da91f30 tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1173.927169] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1173.928034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.928034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.928034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.928034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.928034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.928313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.928362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.928528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.928674] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.928822] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.294051] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.294808] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.294808] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.294808] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.294951] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.295125] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.295294] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.295468] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.295619] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.295838] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1174.295959] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1174.296087] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1174.296199] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1174.296314] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1174.296425] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1174.296688] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1174.314069] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1174.314142] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1174.314302] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1174.314493] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-924" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.314838] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-b72772d6-99a3-4af2-97c1-01eda4a28e8b taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.315063] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-b72772d6-99a3-4af2-97c1-01eda4a28e8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.315204] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-b72772d6-99a3-4af2-97c1-01eda4a28e8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.315542] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-b72772d6-99a3-4af2-97c1-01eda4a28e8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.315692] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72772d6-99a3-4af2-97c1-01eda4a28e8b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.430601] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.430886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.431015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.431261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.431364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.431577] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.431726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.431907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.432123] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.432218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.432322] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 1174.460769] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.460916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.460993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.461207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.461400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.470614] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 1174.593832] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1174.594144] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 1174.594343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.818851] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.819039] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.819253] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.819650] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.819879] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.820318] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port b72772d6-99a3-4af2-97c1-01eda4a28e8b not found, creating... [ 1174.820644] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.820967] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.821308] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.821645] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.821867] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.822343] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.822584] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.822773] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.823128] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.823375] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.823595] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: b72772d6-99a3-4af2-97c1-01eda4a28e8b is going to be created. [ 1174.846052] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.846294] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.846429] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.846733] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.846978] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.847231] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-b72772d6-99a3-4af2-97c1-01eda4a28e8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.335930] env[69777]: INFO networking_nsxv3.common.synchronization [req-907c4ef5-e372-4e7d-92d7-6a1fd9a3745e req-8c37d27d-3f45-448a-83ef-68cd0df7c4ea tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1175.337295] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1175.337295] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.337295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.337295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.337643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.337643] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.337713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.337762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.338908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.339087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.339201] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.620434] env[69777]: INFO networking_nsxv3.common.synchronization [req-be3c8108-f35d-4635-a921-cea32cfa76a3 req-dfad419e-5b4a-4a48-b508-ecb159219b70 service nova] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_rules [ 1175.620775] env[69777]: INFO networking_nsxv3.common.synchronization [req-be3c8108-f35d-4635-a921-cea32cfa76a3 req-dfad419e-5b4a-4a48-b508-ecb159219b70 service nova] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1175.621057] env[69777]: INFO networking_nsxv3.common.synchronization [req-be3c8108-f35d-4635-a921-cea32cfa76a3 req-dfad419e-5b4a-4a48-b508-ecb159219b70 service nova] Enqueued Resource ID: b72772d6-99a3-4af2-97c1-01eda4a28e8b with Priority: HIGHEST for action port [ 1175.621814] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_rules [ 1175.622042] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1175.622234] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72772d6-99a3-4af2-97c1-01eda4a28e8b with Priority: HIGHEST for action port [ 1175.622674] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.623576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.623576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.623576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.623576] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.624815] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.624968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.625619] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b72772d6-99a3-4af2-97c1-01eda4a28e8b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.625822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b72772d6-99a3-4af2-97c1-01eda4a28e8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.625916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b72772d6-99a3-4af2-97c1-01eda4a28e8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.626258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b72772d6-99a3-4af2-97c1-01eda4a28e8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.626395] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72772d6-99a3-4af2-97c1-01eda4a28e8b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.841265] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.128516] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.128695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.128887] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b72772d6-99a3-4af2-97c1-01eda4a28e8b with status ACTIVE [ 1176.129076] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.129195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.129286] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.129466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.129580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.129752] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.129844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.129908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.130087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.130168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.130364] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.130468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.130528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.130668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.130786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.130893] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b72772d6-99a3-4af2-97c1-01eda4a28e8b is going to be updated. [ 1176.151216] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.151362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.151423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.151648] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.151819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.151980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b72772d6-99a3-4af2-97c1-01eda4a28e8b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.343994] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.487711] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 1176.487900] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 deletion is rescheduled due to dependency. [ 1176.488025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.488188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.488403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.488592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.488703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.488791] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.488942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.489031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.489133] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.848156] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.848156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.848156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.848156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.848156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.848156] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1176.877280] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.877513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.877599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.877880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.878140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.890883] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1176.986033] env[69777]: INFO networking_nsxv3.common.synchronization [req-81b9c559-27f3-4479-b5ab-db919c43b8f7 req-854d33ca-29b5-4009-be99-f0771ef3ec90 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1176.988020] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1176.988020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.988020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.988020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.988020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.988020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.988020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.988020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.988020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.988661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.988661] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.992251] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.324370] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.324593] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.324718] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.324984] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.325259] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.325419] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.325543] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.325759] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.325908] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.326171] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.326346] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.326547] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.326748] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.326919] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.327074] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.327247] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.346517] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.346793] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.346960] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.347015] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.347300] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-2df8369c-28df-4f08-af50-b0b48a27909c taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.347473] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-2df8369c-28df-4f08-af50-b0b48a27909c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.347625] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-2df8369c-28df-4f08-af50-b0b48a27909c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.347899] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-2df8369c-28df-4f08-af50-b0b48a27909c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.348052] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2df8369c-28df-4f08-af50-b0b48a27909c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.490583] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.490719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.490719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.490975] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.491083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.491285] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.491396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.491452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.491597] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.491672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.491762] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be deleted. [ 1177.493137] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.521358] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.521358] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.521593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.521639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.521775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.521857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.757607] env[69777]: INFO networking_nsxv3.common.synchronization [None req-0bf758f4-5fa2-4af5-9fea-33251c903b05 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_rules [ 1177.758172] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_rules [ 1177.758478] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad2cbd17-afe0-45e7-973d-4380ccd03877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.758598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.758684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.758984] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.759088] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.828057] env[69777]: INFO networking_nsxv3.common.synchronization [None req-752d8fd8-257d-4bf1-bdc6-f4d68e6f6533 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_rules [ 1177.828602] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_rules [ 1177.829036] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad2cbd17-afe0-45e7-973d-4380ccd03877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.829179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.851549] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.851874] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.852067] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.852359] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.852516] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.852678] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 2df8369c-28df-4f08-af50-b0b48a27909c not found, creating... [ 1177.852962] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.853162] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.853285] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.853533] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.853680] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.853970] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.854152] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.854293] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.854513] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.854655] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.854801] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 2df8369c-28df-4f08-af50-b0b48a27909c is going to be created. [ 1177.872263] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.872450] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.872581] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.872819] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.873074] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.873335] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-2df8369c-28df-4f08-af50-b0b48a27909c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.996868] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.997067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.997161] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.997327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.997469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.997574] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 1178.040409] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.040563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.040622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.040871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.041034] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.049080] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 1178.279809] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.279957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.280059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.280284] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.280374] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.280468] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 already deleted. [ 1178.280554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.280696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.280871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.280955] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.801832] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.802221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.802221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.802346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.802409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.802458] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 already deleted. [ 1178.802536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.874569] env[69777]: INFO networking_nsxv3.common.synchronization [req-81b9c559-27f3-4479-b5ab-db919c43b8f7 req-68b6b9c1-46ef-4eca-aa22-19dc156cd031 service nova] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_rules [ 1178.874754] env[69777]: INFO networking_nsxv3.common.synchronization [req-81b9c559-27f3-4479-b5ab-db919c43b8f7 req-68b6b9c1-46ef-4eca-aa22-19dc156cd031 service nova] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1178.876606] env[69777]: INFO networking_nsxv3.common.synchronization [req-81b9c559-27f3-4479-b5ab-db919c43b8f7 req-68b6b9c1-46ef-4eca-aa22-19dc156cd031 service nova] Enqueued Resource ID: 2df8369c-28df-4f08-af50-b0b48a27909c with Priority: HIGHEST for action port [ 1178.876849] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_rules [ 1178.876982] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1178.877110] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2df8369c-28df-4f08-af50-b0b48a27909c with Priority: HIGHEST for action port [ 1178.877621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.877790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.877790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.877986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.878097] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.878900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.879081] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.879193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.879283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.879457] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.879553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.879553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.879694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.879768] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.879835] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.880553] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2df8369c-28df-4f08-af50-b0b48a27909c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.880745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2df8369c-28df-4f08-af50-b0b48a27909c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.880745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2df8369c-28df-4f08-af50-b0b48a27909c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.880919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2df8369c-28df-4f08-af50-b0b48a27909c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.880996] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2df8369c-28df-4f08-af50-b0b48a27909c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.901145] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1178.901393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.961711] env[69777]: INFO networking_nsxv3.common.synchronization [req-c6c7e7d1-f3fc-461a-bd85-e25ba447d8da req-d6621678-a592-469d-afdf-c1e1b712c469 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 1178.966530] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 1178.966960] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.967110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.967180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.967578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.967578] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.967870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.967870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.967932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.968016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.968071] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.383098] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.383255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.387402] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2df8369c-28df-4f08-af50-b0b48a27909c with status ACTIVE [ 1179.387610] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.387788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.387788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.387989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.388097] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.388271] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.388364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.388424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.388576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.388658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.388886] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.388982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.389073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.389143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.389215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.389297] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2df8369c-28df-4f08-af50-b0b48a27909c is going to be updated. [ 1179.390345] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.394618] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.394618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.394618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.394618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.394618] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.394618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.394618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.394618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.394618] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.394618] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.394618] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.394618] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.394618] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.395154] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.395154] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.395154] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.412097] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.412322] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.412464] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.412637] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-958" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.412933] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-0f90f7a8-c369-48b0-84ab-fef45afac599 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.413139] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-0f90f7a8-c369-48b0-84ab-fef45afac599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.413262] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-0f90f7a8-c369-48b0-84ab-fef45afac599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.413592] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-0f90f7a8-c369-48b0-84ab-fef45afac599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.413742] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f90f7a8-c369-48b0-84ab-fef45afac599',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.415370] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.415489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.415555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.415719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.415842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.416238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2df8369c-28df-4f08-af50-b0b48a27909c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.472953] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.896242] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.917440] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.917721] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.917802] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.918141] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.918313] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.918514] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 0f90f7a8-c369-48b0-84ab-fef45afac599 not found, creating... [ 1179.918807] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.918990] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.919196] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.919403] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.919594] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.919920] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.920156] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.920323] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.920573] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.920731] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.921013] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 0f90f7a8-c369-48b0-84ab-fef45afac599 is going to be created. [ 1179.943553] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.943817] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.943993] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.944340] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.944839] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.945045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-0f90f7a8-c369-48b0-84ab-fef45afac599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.973876] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.057209] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 1180.057436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.057643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.057863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.058087] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.058213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.058281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.058480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.058530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.058614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.058709] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.398948] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.399110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.399157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.399353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.399448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.399549] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be created. [ 1180.422371] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.422507] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.422548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.422731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.422888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.431016] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: UNINITIALIZED for 2s [ 1180.475982] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.476149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.476222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.476430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.476535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.476635] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 is going to be updated. [ 1180.501330] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.501458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.501500] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.501701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.501846] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.511069] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: IN_PROGRESS for 2s [ 1180.561028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.561219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.561294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.561522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.561698] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.561872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.561872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.565030] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.565030] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.565030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.565030] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.608283] env[69777]: INFO networking_nsxv3.common.synchronization [req-c6c7e7d1-f3fc-461a-bd85-e25ba447d8da req-b2f657b9-0e17-49bd-b11c-bde5c58a4331 service nova] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_rules [ 1180.608468] env[69777]: INFO networking_nsxv3.common.synchronization [req-c6c7e7d1-f3fc-461a-bd85-e25ba447d8da req-b2f657b9-0e17-49bd-b11c-bde5c58a4331 service nova] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 1180.608613] env[69777]: INFO networking_nsxv3.common.synchronization [req-c6c7e7d1-f3fc-461a-bd85-e25ba447d8da req-b2f657b9-0e17-49bd-b11c-bde5c58a4331 service nova] Enqueued Resource ID: 0f90f7a8-c369-48b0-84ab-fef45afac599 with Priority: HIGHEST for action port [ 1180.608885] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_rules [ 1180.609021] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 1180.609122] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f90f7a8-c369-48b0-84ab-fef45afac599 with Priority: HIGHEST for action port [ 1180.609680] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.609812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.609867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.610229] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.610321] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.612081] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.612190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.612394] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f90f7a8-c369-48b0-84ab-fef45afac599 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.612496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f90f7a8-c369-48b0-84ab-fef45afac599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.612562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f90f7a8-c369-48b0-84ab-fef45afac599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.612738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f90f7a8-c369-48b0-84ab-fef45afac599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.612814] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f90f7a8-c369-48b0-84ab-fef45afac599',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.065879] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2102ed9-efb2-4a2c-a170-b1e7872f4215: rpc.has_security_group_logging(os_id): False [ 1181.083209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.083373] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.083476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.083780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.083937] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.084180] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.084289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.084367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.084506] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.084584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.084786] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.084902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.084967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.085129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.085203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.085424] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.085537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.085612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.085775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.085869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.085956] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 1181.112978] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.113440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.114749] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f90f7a8-c369-48b0-84ab-fef45afac599 with status ACTIVE [ 1181.114950] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.115093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.115156] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.115364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.115452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.115625] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.115723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.115788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.115935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.116026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.116211] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.116316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.116379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.116504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.116558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.116640] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f90f7a8-c369-48b0-84ab-fef45afac599 is going to be updated. [ 1181.137483] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.137642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.137681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.137865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.138023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.138183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f90f7a8-c369-48b0-84ab-fef45afac599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.141123] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.141304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.141380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.141570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.141702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.156285] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 1182.439840] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1182.440128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.440241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.440460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.440649] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.440836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.440836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.441059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.441100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.441198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.441301] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.522009] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: SUCCESS [ 1182.522249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.522435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.522640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.522848] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.522965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.523047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.523187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.523263] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.523354] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.946170] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.946347] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.946422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.946655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.946864] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.947056] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.947158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.947371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.947471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.947566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.947750] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.947860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.947926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.948135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.948327] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.948443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.948519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.948671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.948812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.948876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.948967] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.025803] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.172184] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 1183.172436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.451863] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a80d85d-9154-4a27-bab2-481460122696: rpc.has_security_group_logging(os_id): False [ 1183.470352] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.471167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.471167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.471167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.471167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.471167] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.471167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.471477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.471477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.471558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.471738] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.471828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.471828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.472098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.472098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.472257] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.472679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.472679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.472679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.472679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.472679] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be created. [ 1183.512701] env[69777]: INFO networking_nsxv3.common.synchronization [None req-9fb81604-15d8-46f4-8cbc-4e5a4b228b39 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1183.513203] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1183.513536] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.513665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.513747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.513945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.514116] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.514223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.514282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.514438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.514521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.514620] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.528184] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.528361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.529498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.529498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.529498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.537187] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.545453] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1184.017102] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.034469] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.034660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.034719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.035049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.035194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.035305] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 is going to be updated. [ 1184.071117] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.071117] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.071117] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.071318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.071472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.086626] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: IN_PROGRESS for 2s [ 1184.519332] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.023153] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.023351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.023430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.023661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.023743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.023846] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1185.052147] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.052326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.052400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.052615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.053066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.061708] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1185.558207] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1185.558530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.685295] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.685501] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.685631] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.685903] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.686180] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.686343] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.686467] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.686683] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.686838] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.687063] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.687185] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.687301] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.687461] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.687617] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.687758] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.687939] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.706071] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.706721] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1185.706721] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.706843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.707134] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-55aa95c5-d97d-4515-9136-cd170dc125be taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.707321] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-55aa95c5-d97d-4515-9136-cd170dc125be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.707449] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-55aa95c5-d97d-4515-9136-cd170dc125be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.707759] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-55aa95c5-d97d-4515-9136-cd170dc125be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.707904] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55aa95c5-d97d-4515-9136-cd170dc125be',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.097044] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: SUCCESS [ 1186.097171] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.097296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.097509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.097701] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.097826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.097895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.098023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.098109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.098192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.098282] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.210500] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.210740] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.211178] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.211178] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.211336] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.211496] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 55aa95c5-d97d-4515-9136-cd170dc125be not found, creating... [ 1186.211755] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.211958] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.212134] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.212369] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.212514] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.212798] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.212955] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.213135] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.213376] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.213512] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.213763] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 55aa95c5-d97d-4515-9136-cd170dc125be is going to be created. [ 1186.232290] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.232520] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.232687] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.232971] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.233275] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.233558] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-55aa95c5-d97d-4515-9136-cd170dc125be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.600690] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.955239] env[69777]: INFO networking_nsxv3.common.synchronization [req-045f26c4-b67b-4749-8a90-c17192a79328 req-ee44c531-3541-4894-967e-c97b7476605e tempest-AttachVolumeShelveTestJSON-523183173 tempest-AttachVolumeShelveTestJSON-523183173-project-member] Enqueued Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_members [ 1186.955239] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGHEST for action security_group_members [ 1186.955239] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.955239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.955239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.955239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.955239] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.955239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.955239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.955600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.955600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.955600] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.071268] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1187.071520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.103053] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb60d30-acd9-42ec-9942-d71d6c7c14f6: rpc.has_security_group_logging(os_id): False [ 1187.118422] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.118571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.118644] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.118908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.136859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.136859] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.136859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.136859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.136859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.136859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.136859] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 is going to be updated. [ 1187.193958] env[69777]: INFO networking_nsxv3.common.synchronization [req-aa7b58a7-2ba0-40c0-a65b-dc6b33756d8a req-95aa3237-dbfe-4ff8-b5c2-ae99364264f4 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_members [ 1187.195858] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.196105] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.196238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.196527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.196737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.199993] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_members [ 1187.200400] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2cbd17-afe0-45e7-973d-4380ccd03877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.201912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.202089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.202573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.202819] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.202977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.203101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.203309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.203448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.203573] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.214927] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: IN_PROGRESS for 2s [ 1187.356619] env[69777]: INFO networking_nsxv3.common.synchronization [req-0c73c67c-a878-4b6b-afdd-92f692558de6 req-dca31a36-0322-4e7a-babc-522c00ebeb8f service nova] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_rules [ 1187.356904] env[69777]: INFO networking_nsxv3.common.synchronization [req-0c73c67c-a878-4b6b-afdd-92f692558de6 req-dca31a36-0322-4e7a-babc-522c00ebeb8f service nova] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1187.356949] env[69777]: INFO networking_nsxv3.common.synchronization [req-0c73c67c-a878-4b6b-afdd-92f692558de6 req-dca31a36-0322-4e7a-babc-522c00ebeb8f service nova] Enqueued Resource ID: 55aa95c5-d97d-4515-9136-cd170dc125be with Priority: HIGHEST for action port [ 1187.357180] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_rules [ 1187.357306] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1187.357404] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55aa95c5-d97d-4515-9136-cd170dc125be with Priority: HIGHEST for action port [ 1187.358280] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.358600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.358600] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.358749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.358749] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.360109] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.360109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.360109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.360591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.360591] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.360591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.360591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.360734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.360766] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.361117] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.361690] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-55aa95c5-d97d-4515-9136-cd170dc125be taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.361838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55aa95c5-d97d-4515-9136-cd170dc125be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.361948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55aa95c5-d97d-4515-9136-cd170dc125be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.362053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55aa95c5-d97d-4515-9136-cd170dc125be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.362129] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55aa95c5-d97d-4515-9136-cd170dc125be',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.457381] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.457542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.457594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.457850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.479770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.480040] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.480172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.480243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.480452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.480541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.480727] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 is going to be updated. [ 1187.503943] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.503943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.504141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.505059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.505059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.513534] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 in Status: IN_PROGRESS for 2s [ 1187.710034] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.711062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.711062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.711062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.711062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.711062] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.711062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.711062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.711379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.711379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.711379] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 already deleted. [ 1187.711379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.753114] env[69777]: INFO networking_nsxv3.common.synchronization [req-818189fb-2286-4bc6-8af9-2b2f2d25318d req-672ffe1b-9b85-44e3-a0c9-8b182ab3e3bf tempest-ServerDiskConfigTestJSON-1947163457 tempest-ServerDiskConfigTestJSON-1947163457-project-member] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1187.753876] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGHEST for action security_group_members [ 1187.754246] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.754378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.754447] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.754650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.754802] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.754901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.754967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.755130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.755216] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.755309] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.774994] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.775283] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.775413] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.775737] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.775944] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.776132] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.776255] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.776469] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.776615] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.776861] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.776989] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.777118] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.777232] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.777347] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.777461] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.777985] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.799103] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.799283] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.799444] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.799643] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.802658] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-d4d693eb-fcb4-4e1a-9db6-e53a9a48c423 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.802658] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-d4d693eb-fcb4-4e1a-9db6-e53a9a48c423" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.802658] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-d4d693eb-fcb4-4e1a-9db6-e53a9a48c423" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.802658] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-d4d693eb-fcb4-4e1a-9db6-e53a9a48c423" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.802658] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4d693eb-fcb4-4e1a-9db6-e53a9a48c423',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.863757] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.863883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.864094] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.864925] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55aa95c5-d97d-4515-9136-cd170dc125be with status ACTIVE [ 1187.865145] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.865257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.865344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.865548] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.865627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.865804] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.865887] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.865961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.866097] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.866174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.866342] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.866427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.866499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.866625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.866695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.866773] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55aa95c5-d97d-4515-9136-cd170dc125be is going to be updated. [ 1187.887583] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.887728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.887792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.888007] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.888154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.888308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55aa95c5-d97d-4515-9136-cd170dc125be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.261957] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.261957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.261957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.262262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.262303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.262503] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.262631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.262708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.262902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.263031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.263115] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be updated. [ 1188.290239] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.291143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.291143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.291143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.291143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.300602] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: IN_PROGRESS for 2s [ 1188.304257] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.304972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.304972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.304972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.305182] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.305337] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port d4d693eb-fcb4-4e1a-9db6-e53a9a48c423 not found, creating... [ 1188.305640] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.305815] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.305940] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.306180] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.306327] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.306692] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.306892] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.307105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.307419] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.307595] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.307805] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: d4d693eb-fcb4-4e1a-9db6-e53a9a48c423 is going to be created. [ 1188.327115] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.327454] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.327621] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.327898] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.328172] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.328429] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-d4d693eb-fcb4-4e1a-9db6-e53a9a48c423" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.369131] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.871890] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.872720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.874874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.874874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.874874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.874874] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1188.901151] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.901151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.901151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.901151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.901151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.909536] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1189.229554] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: SUCCESS [ 1189.229720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.244150] env[69777]: INFO networking_nsxv3.common.synchronization [req-aa7b58a7-2ba0-40c0-a65b-dc6b33756d8a req-56e842fd-243b-46c8-bb21-1883067bf7b5 service nova] Enqueued Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_rules [ 1189.244150] env[69777]: INFO networking_nsxv3.common.synchronization [req-aa7b58a7-2ba0-40c0-a65b-dc6b33756d8a req-56e842fd-243b-46c8-bb21-1883067bf7b5 service nova] Enqueued Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_members [ 1189.244150] env[69777]: INFO networking_nsxv3.common.synchronization [req-aa7b58a7-2ba0-40c0-a65b-dc6b33756d8a req-56e842fd-243b-46c8-bb21-1883067bf7b5 service nova] Enqueued Resource ID: d4d693eb-fcb4-4e1a-9db6-e53a9a48c423 with Priority: HIGHEST for action port [ 1189.244150] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_rules [ 1189.244150] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_members [ 1189.244150] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d693eb-fcb4-4e1a-9db6-e53a9a48c423 with Priority: HIGHEST for action port [ 1189.244150] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad2cbd17-afe0-45e7-973d-4380ccd03877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.244150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.244150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.244529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.244529] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.245498] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2cbd17-afe0-45e7-973d-4380ccd03877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.245498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.245620] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.245781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.245939] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.245996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.246072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.246236] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.246345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.246511] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.247349] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4d693eb-fcb4-4e1a-9db6-e53a9a48c423 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.247622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4d693eb-fcb4-4e1a-9db6-e53a9a48c423" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.247622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4d693eb-fcb4-4e1a-9db6-e53a9a48c423" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.247953] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4d693eb-fcb4-4e1a-9db6-e53a9a48c423" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.247953] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4d693eb-fcb4-4e1a-9db6-e53a9a48c423',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.372970] env[69777]: INFO networking_nsxv3.common.synchronization [req-208f9782-0650-41b5-b461-5e1c16ae68e1 req-c35a1191-6944-4358-95e6-d9d93928b5b7 tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1189.373946] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1189.373946] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.374945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.374945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.374945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.375360] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.375418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.375484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.375692] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.375817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.375945] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.524603] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 in Status: SUCCESS [ 1189.524603] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 deletion is rescheduled due to dependency. [ 1189.524603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.673660] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.673660] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.673814] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.674047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.674333] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.674494] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.674614] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.675307] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.675307] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.675307] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.675482] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.675482] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.675581] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.675703] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.675818] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.675971] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.695131] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.695386] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1189.695600] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.695860] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.696355] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-98c446fe-0359-4686-a765-f575968ea637 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.696589] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-98c446fe-0359-4686-a765-f575968ea637" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.696780] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-98c446fe-0359-4686-a765-f575968ea637" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.697227] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-98c446fe-0359-4686-a765-f575968ea637" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.697566] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c446fe-0359-4686-a765-f575968ea637',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.749266] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2cbd17-afe0-45e7-973d-4380ccd03877 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.749483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.749669] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.750517] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4d693eb-fcb4-4e1a-9db6-e53a9a48c423 with status ACTIVE [ 1189.750936] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.750936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.751108] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.751373] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.751515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.751739] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.751881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.751998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.752215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.752330] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.752553] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.752685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.752773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.752986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.753117] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.753293] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4d693eb-fcb4-4e1a-9db6-e53a9a48c423 is going to be updated. [ 1189.832584] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.832752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.832815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.833286] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.833522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.833762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4d693eb-fcb4-4e1a-9db6-e53a9a48c423" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.878162] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.878622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.878622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.878622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.878752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.878911] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.879043] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.879112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.879270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.879376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.879487] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1189.912865] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.913241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.913567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.913884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.913992] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.922871] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1190.203829] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.204015] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.204189] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.204462] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.204624] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.204823] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 98c446fe-0359-4686-a765-f575968ea637 not found, creating... [ 1190.205128] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.205303] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.205451] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.205728] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.205891] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.206238] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.206412] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.206536] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.206760] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.206921] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.207098] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 98c446fe-0359-4686-a765-f575968ea637 is going to be created. [ 1190.227667] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.227930] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.228089] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.228410] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.228969] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.229096] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-98c446fe-0359-4686-a765-f575968ea637" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.255574] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.316481] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 in Status: SUCCESS [ 1190.316683] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 deletion is rescheduled due to dependency. [ 1190.316868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.758247] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.758763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.758852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.759077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.759173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.759275] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 is going to be created. [ 1190.795156] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.795290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.795396] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.795578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.795741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.804582] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 in Status: UNINITIALIZED for 2s [ 1190.920437] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1190.920437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.920437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.920437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.920437] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.920437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.920437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.920437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.920437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.920437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.920437] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.935229] env[69777]: INFO networking_nsxv3.common.synchronization [req-208f9782-0650-41b5-b461-5e1c16ae68e1 req-7301f130-73a1-4875-bdef-a0fdeeb95767 service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 1190.935229] env[69777]: INFO networking_nsxv3.common.synchronization [req-208f9782-0650-41b5-b461-5e1c16ae68e1 req-7301f130-73a1-4875-bdef-a0fdeeb95767 service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1190.935229] env[69777]: INFO networking_nsxv3.common.synchronization [req-208f9782-0650-41b5-b461-5e1c16ae68e1 req-7301f130-73a1-4875-bdef-a0fdeeb95767 service nova] Enqueued Resource ID: 98c446fe-0359-4686-a765-f575968ea637 with Priority: HIGHEST for action port [ 1190.935229] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 1190.935229] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1190.935229] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c446fe-0359-4686-a765-f575968ea637 with Priority: HIGHEST for action port [ 1190.937184] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.937312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.937376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.937563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.937641] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.940371] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.940502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.940665] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-98c446fe-0359-4686-a765-f575968ea637 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.940755] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98c446fe-0359-4686-a765-f575968ea637" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.940819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98c446fe-0359-4686-a765-f575968ea637" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.941051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98c446fe-0359-4686-a765-f575968ea637" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.941114] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c446fe-0359-4686-a765-f575968ea637',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.422768] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.422907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.422988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.423229] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.423395] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.423494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.423558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.423705] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.423790] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.423879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.424039] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.424145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.424193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.424427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.424681] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.424826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.425424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.425424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.425424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.425424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.425424] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.443221] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.443221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.443383] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98c446fe-0359-4686-a765-f575968ea637 with status ACTIVE [ 1191.443614] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.443795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.443795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.443974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.444069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.444174] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.444269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.444332] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.444474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.444551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.444726] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.444831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.444872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.445017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.445111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.445178] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98c446fe-0359-4686-a765-f575968ea637 is going to be updated. [ 1191.470171] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.470351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.470418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.470691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.470803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.471029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98c446fe-0359-4686-a765-f575968ea637" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.638689] env[69777]: INFO networking_nsxv3.common.synchronization [req-8eeffb9d-6e13-4ce2-9f48-682042444a38 req-b207c8e1-1400-47d7-9b5a-703c1c850dfd tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1191.639741] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1191.639741] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.639886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.639977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.641579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.641579] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.641579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.641579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.641579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.641579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.641579] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.928276] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a80d85d-9154-4a27-bab2-481460122696: rpc.has_security_group_logging(os_id): False [ 1191.942652] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1191.942811] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 1191.942940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.943137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.943505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.943709] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.943866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.943903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.944093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.944249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.944295] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.947615] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.947688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.947725] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.951023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.951023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.951023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.951023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.951665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.951665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.951665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.951665] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1192.016424] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.016589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.016679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.016968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.017221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.032386] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1192.101582] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.101813] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.101984] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.102284] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.102557] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.102721] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.102843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.103981] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.104208] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.104437] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.104564] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1192.104681] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1192.104791] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1192.104927] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.105063] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1192.105204] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1192.131685] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1192.131943] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1192.132131] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1192.132334] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-114" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.132669] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-378e2fdd-197c-443a-b2b3-2856f45e5086 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.132893] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-378e2fdd-197c-443a-b2b3-2856f45e5086" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.133041] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-378e2fdd-197c-443a-b2b3-2856f45e5086" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.133473] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-378e2fdd-197c-443a-b2b3-2856f45e5086" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.133552] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('378e2fdd-197c-443a-b2b3-2856f45e5086',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.142906] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.447966] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.637244] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.637450] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.637585] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.637876] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.638047] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.638215] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 378e2fdd-197c-443a-b2b3-2856f45e5086 not found, creating... [ 1192.638525] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.638694] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.638821] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.639154] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.639303] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.639601] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.639767] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.639891] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.640121] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.640480] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.640480] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 378e2fdd-197c-443a-b2b3-2856f45e5086 is going to be created. [ 1192.645156] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.659816] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.660023] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.660157] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.660431] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.660662] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.660976] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-378e2fdd-197c-443a-b2b3-2856f45e5086" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.814675] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 in Status: SUCCESS [ 1192.814955] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.815160] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.815382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.815572] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.815689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.815746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.815927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.816055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.816179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.816257] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.949871] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.149769] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.149769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.149769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.149769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.149769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.149769] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1193.176099] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.176277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.176397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.176667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.177071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.185461] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1193.318820] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.454536] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.454650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.454721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.454953] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.455067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.455165] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1193.457930] env[69777]: INFO networking_nsxv3.common.synchronization [req-8eeffb9d-6e13-4ce2-9f48-682042444a38 req-4e5adc1b-b96c-44d0-af20-0fbc5d2d71d4 service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 1193.458129] env[69777]: INFO networking_nsxv3.common.synchronization [req-8eeffb9d-6e13-4ce2-9f48-682042444a38 req-4e5adc1b-b96c-44d0-af20-0fbc5d2d71d4 service nova] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1193.458276] env[69777]: INFO networking_nsxv3.common.synchronization [req-8eeffb9d-6e13-4ce2-9f48-682042444a38 req-4e5adc1b-b96c-44d0-af20-0fbc5d2d71d4 service nova] Enqueued Resource ID: 378e2fdd-197c-443a-b2b3-2856f45e5086 with Priority: HIGHEST for action port [ 1193.460400] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_rules [ 1193.462687] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1193.462687] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378e2fdd-197c-443a-b2b3-2856f45e5086 with Priority: HIGHEST for action port [ 1193.462687] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.462687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.462687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.462687] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.462687] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.463095] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.463195] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.463400] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-378e2fdd-197c-443a-b2b3-2856f45e5086 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.463497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-378e2fdd-197c-443a-b2b3-2856f45e5086" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.463550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-378e2fdd-197c-443a-b2b3-2856f45e5086" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.463866] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-378e2fdd-197c-443a-b2b3-2856f45e5086" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.463933] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('378e2fdd-197c-443a-b2b3-2856f45e5086',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.486427] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.490172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.490172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.490172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.490172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.500415] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1193.821917] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad2cbd17-afe0-45e7-973d-4380ccd03877: rpc.has_security_group_logging(os_id): False [ 1193.844264] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.844486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.844576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.844807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.845100] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.845432] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.845735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.845843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.846098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.846225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.846348] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 is going to be created. [ 1193.907954] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.908187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.908187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.908421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.908598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.924026] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 in Status: IN_PROGRESS for 2s [ 1193.966200] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.966200] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.967192] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 378e2fdd-197c-443a-b2b3-2856f45e5086 with status ACTIVE [ 1193.967375] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.967479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.967545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.967743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.967832] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.968016] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.968134] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.968192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.968318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.968395] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.968582] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.968679] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.968727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.968847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.968936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.969030] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 378e2fdd-197c-443a-b2b3-2856f45e5086 is going to be updated. [ 1194.013056] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.013267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.013267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.013475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.013613] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.013774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-378e2fdd-197c-443a-b2b3-2856f45e5086" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.057939] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1194.057939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.344123] env[69777]: INFO networking_nsxv3.common.synchronization [None req-423df9c2-3869-4cdf-95f0-b8606befd18d tempest-AttachVolumeShelveTestJSON-523183173 tempest-AttachVolumeShelveTestJSON-523183173-project-member] Enqueued Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_rules [ 1194.344619] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_rules [ 1194.344933] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.345111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.345225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.345567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.345698] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.416817] env[69777]: INFO networking_nsxv3.common.synchronization [None req-36bd4955-88a3-442c-8321-5c16ac9edf1a tempest-AttachVolumeShelveTestJSON-523183173 tempest-AttachVolumeShelveTestJSON-523183173-project-member] Enqueued Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_rules [ 1194.416817] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_rules [ 1194.416817] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.416817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.867210] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.867597] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.867741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.867987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.868109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.869329] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 already deleted. [ 1194.869438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.869999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.870202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.870313] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.207279] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1195.207279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.207279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.207279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.207279] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.207279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.207279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.207279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.207279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.207279] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.391527] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.391685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.391803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.392197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.392327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.392438] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 already deleted. [ 1195.392531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.509149] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1195.509410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.509583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.509810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.510030] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.510183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.510245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.510414] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.510537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.510586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.510664] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.704105] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.947559] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 in Status: SUCCESS [ 1195.947830] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.013688] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.013688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.013688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.014049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.014049] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.014159] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.014204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.014338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.014430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.014538] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.014682] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.014786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.014852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.015033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.015200] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.015378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.015462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.015611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.015738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.015786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.015871] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.207235] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.519610] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44fd483-f70f-4a69-967b-e48536b42565: rpc.has_security_group_logging(os_id): False [ 1196.545378] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.545645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.545706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.546074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.546074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.546451] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.546571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.546635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.546801] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.546894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.547140] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.547289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.547466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.547636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.547716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.547914] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.548019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.548095] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.548349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.548494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.548675] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1196.612311] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.612533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.612662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.613014] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.613229] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.633366] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1196.709266] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.709471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.709513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.709736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.709831] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.709958] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1196.753822] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.753926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.753999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.754231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.754401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.797223] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1198.649038] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1198.649338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.815432] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1198.815877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.815877] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.816084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.816258] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.816388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.816454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.816605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.816746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.816959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.816959] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.320073] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.320073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.320073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.320370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.320370] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.320451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.320519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.320716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.320811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.320945] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.321124] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.321231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.321294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.321458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.321614] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.321709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.321770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.321907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.322010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.322098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.322185] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.417579] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1199.417579] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1199.824893] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06bee688-2b64-4a9b-b0eb-ee4c735a9c41: rpc.has_security_group_logging(os_id): False [ 1199.841069] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.841845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.841845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.841845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.841845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.841845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.842061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.842061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.842149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.842235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.842439] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.842543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.842619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.842723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.842785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.843085] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.843085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.843244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.843310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.843362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.843426] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1199.863102] env[69777]: INFO networking_nsxv3.common.synchronization [req-61e7ad62-86df-43ce-8258-649ce323eae2 req-14d7577d-a9c4-4250-b7ea-f6bfd2fc3245 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1199.863678] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1199.866425] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.866564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.866629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.866823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.866988] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.867111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.867209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.867424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.867522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.867619] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.904130] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.904130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.904343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.904378] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.904941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.915854] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1200.370022] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.500841] env[69777]: INFO networking_nsxv3.common.synchronization [None req-1be8c881-e7b9-4db9-9dc2-a172289083aa tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1200.501564] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1200.501978] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.502140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.872866] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.378736] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.378972] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.379035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.379270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.379355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.379461] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1201.405569] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.405738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.405810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.406031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.406181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.414314] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1201.927578] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1201.927850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.424080] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1203.424436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.424543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.424828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.425060] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.425213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.425311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.425498] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.425606] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.425723] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.856676] env[69777]: INFO networking_nsxv3.common.synchronization [req-93546d8e-14a9-44ee-9ad3-29ed17d85233 req-8c7c4086-6690-4829-8cf9-b346b2f81b40 tempest-AttachVolumeShelveTestJSON-523183173 tempest-AttachVolumeShelveTestJSON-523183173-project-member] Enqueued Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_members [ 1203.857288] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_members [ 1203.857617] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.858254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.858398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.859161] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.860184] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.860328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.860400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.860571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.860657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.860755] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.927488] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.927644] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.927716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.927921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.928024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.928217] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.928314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.928377] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.928523] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.928601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.928687] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1203.955696] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.955858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.955914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.956127] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.956694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.964333] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1204.141974] env[69777]: INFO networking_nsxv3.common.synchronization [req-e0b80767-26d6-47fa-948d-b566e9ae4137 req-78348cd9-1b8f-4805-afeb-eda4ab3e8055 tempest-ImagesOneServerTestJSON-1932271102 tempest-ImagesOneServerTestJSON-1932271102-project-member] Enqueued Resource ID: dfaae587-8793-4f50-bc13-dd477aa227cd with Priority: HIGHEST for action security_group_members [ 1204.142715] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfaae587-8793-4f50-bc13-dd477aa227cd with Priority: HIGHEST for action security_group_members [ 1204.143073] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfaae587-8793-4f50-bc13-dd477aa227cd taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.143199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.143267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.143469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.143621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.143723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.143787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.143936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.144032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.144133] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfaae587-8793-4f50-bc13-dd477aa227cd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.255740] env[69777]: INFO networking_nsxv3.common.synchronization [req-06e6df73-ae6f-481d-94ac-2ba1710c8465 req-7c25987c-c4b2-4f4c-9b68-64d64c90ae3f tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1204.256966] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1204.257231] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.257420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.257561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.257829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.258091] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.258258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.258375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.258624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.258768] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.258928] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.355767] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.355992] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.356148] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.356428] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.356691] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.356849] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.356967] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.357325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.357483] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.357700] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.357816] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.358120] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.358120] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.358394] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.358394] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.358505] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.364100] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.364259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.364334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.364521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.364638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.364848] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.364946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.365015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.365210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.365294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.365382] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 already deleted. [ 1204.365567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.380881] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.381146] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1204.381322] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.381503] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.381830] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-f683730e-0cea-4d44-a1ba-951809ac77e9 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.382018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.382192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.382603] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.382749] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f683730e-0cea-4d44-a1ba-951809ac77e9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.585029] env[69777]: INFO networking_nsxv3.common.synchronization [req-eb9aaa28-1247-4d64-82d5-053d0b302362 req-39741907-66cb-4b5f-b148-a994b892bfaa tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1204.585029] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1204.585454] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.585537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.585636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.585901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.586105] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.586253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.586352] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.586544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.586671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.586801] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.773796] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.774023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.774110] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.777714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.779182] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.779277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.801421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.801677] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.801798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.801868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.802125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.802210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.802305] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfaae587-8793-4f50-bc13-dd477aa227cd is going to be updated. [ 1204.803244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.803474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.822155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.822258] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.822399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.823802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.823802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.823802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.823802] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be updated. [ 1204.829023] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.829023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.829023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.829209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.829209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.835332] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfaae587-8793-4f50-bc13-dd477aa227cd in Status: IN_PROGRESS for 2s [ 1204.849140] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.849252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.849339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.849482] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.849607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.857216] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: IN_PROGRESS for 2s [ 1204.886830] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.887053] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.887178] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.887420] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.887567] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.887731] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port f683730e-0cea-4d44-a1ba-951809ac77e9 not found, creating... [ 1204.887994] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.888168] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.888288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.888502] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.888641] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.888931] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.889107] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.889229] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.889436] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.889574] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.889714] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: f683730e-0cea-4d44-a1ba-951809ac77e9 is going to be created. [ 1204.913820] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.913989] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.914136] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.914381] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.914579] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.914782] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.089223] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.089591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.089591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.089776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.089776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.089987] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.089987] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.090292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.090292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.090292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.090549] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1205.118038] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.118204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.118276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.118479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.118651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.125953] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1205.628534] env[69777]: INFO networking_nsxv3.common.synchronization [req-93546d8e-14a9-44ee-9ad3-29ed17d85233 req-c2ac1579-8363-44a8-8bf3-53da46f55c49 service nova] Enqueued Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_rules [ 1205.628756] env[69777]: INFO networking_nsxv3.common.synchronization [req-93546d8e-14a9-44ee-9ad3-29ed17d85233 req-c2ac1579-8363-44a8-8bf3-53da46f55c49 service nova] Enqueued Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_members [ 1205.628841] env[69777]: INFO networking_nsxv3.common.synchronization [req-93546d8e-14a9-44ee-9ad3-29ed17d85233 req-c2ac1579-8363-44a8-8bf3-53da46f55c49 service nova] Enqueued Resource ID: f683730e-0cea-4d44-a1ba-951809ac77e9 with Priority: HIGHEST for action port [ 1205.629129] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_rules [ 1205.629255] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_members [ 1205.629343] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f683730e-0cea-4d44-a1ba-951809ac77e9 with Priority: HIGHEST for action port [ 1205.629882] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.630113] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.630427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.630900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.630900] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.632072] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.633130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.633130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.633130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.633130] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.633130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.633130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.633130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.633130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.633130] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.633956] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f683730e-0cea-4d44-a1ba-951809ac77e9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.633956] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.634158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.634202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.634338] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f683730e-0cea-4d44-a1ba-951809ac77e9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.974807] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1205.975129] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 deletion is rescheduled due to dependency. [ 1205.975129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.136598] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.137149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.137149] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.137847] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f683730e-0cea-4d44-a1ba-951809ac77e9 with status ACTIVE [ 1206.138040] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.138160] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.138225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.138434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.138509] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.138680] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.138772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.138914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.139019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.139106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.139290] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.139381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.139441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.139578] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.139655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.139737] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f683730e-0cea-4d44-a1ba-951809ac77e9 is going to be updated. [ 1206.159909] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.160132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.160228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.160433] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.160570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.160735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.643245] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.854225] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfaae587-8793-4f50-bc13-dd477aa227cd in Status: SUCCESS [ 1206.854780] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfaae587-8793-4f50-bc13-dd477aa227cd deletion is rescheduled due to dependency. [ 1206.854780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfaae587-8793-4f50-bc13-dd477aa227cd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.865920] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 1206.866509] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e deletion is rescheduled due to dependency. [ 1206.866628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.135370] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1207.135574] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 1207.135724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.146243] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.146387] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.146445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.146656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.146743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.146840] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 is going to be created. [ 1207.166590] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.166729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.166777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.167052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.167227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.177364] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 in Status: UNINITIALIZED for 2s [ 1207.534008] env[69777]: INFO networking_nsxv3.common.synchronization [req-02013489-81e8-4573-b8ae-8a812ae17d37 req-c148d2a1-de27-4dfd-9c32-6b56c1082b61 tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1207.534600] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1207.534907] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.535868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.535868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.535868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.535868] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.535868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.535868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.535868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.535868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.536215] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.038418] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.542888] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.045191] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.045499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.045499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.045629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.045699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.045809] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1209.086456] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.086623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.086684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.086879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.087035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.096075] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1209.186514] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 in Status: SUCCESS [ 1209.186869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.186869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.187248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.187343] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.187420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.187420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.187582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.187660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.187745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.187833] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.692392] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.193603] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f4ac00d-66c7-42bf-aa2f-53b5984883e3: rpc.has_security_group_logging(os_id): False [ 1210.210204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.210382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.210465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.210702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.210826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.211204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.211321] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.211384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.211565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.211643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.211750] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 is going to be created. [ 1210.267593] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.267593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.267593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.267593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.267847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.279516] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 in Status: IN_PROGRESS for 2s [ 1210.350127] env[69777]: INFO networking_nsxv3.common.synchronization [req-ef8f85d0-31f5-428e-b15c-296cc39769d8 req-a7d0814f-a982-4d99-8565-7991389ee8b1 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_members [ 1210.350625] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGHEST for action security_group_members [ 1210.350947] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7b1a811-2cde-4056-af4d-31f7ea781dba taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.351112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.351184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.351380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.351529] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.351622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.351683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.351825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.351906] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.351996] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.854575] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.854716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.854795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.855011] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.874536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.874784] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.874915] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.875009] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.875206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.875293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.875385] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b1a811-2cde-4056-af4d-31f7ea781dba is going to be updated. [ 1210.897830] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.897960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.898028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.898244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.898508] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.905373] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b1a811-2cde-4056-af4d-31f7ea781dba in Status: IN_PROGRESS for 2s [ 1211.105121] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1211.105327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.289887] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 in Status: SUCCESS [ 1212.290169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.914170] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7b1a811-2cde-4056-af4d-31f7ea781dba in Status: SUCCESS [ 1212.914350] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7b1a811-2cde-4056-af4d-31f7ea781dba deletion is rescheduled due to dependency. [ 1212.914462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.352016] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.352433] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1217.819062] env[69777]: INFO networking_nsxv3.common.synchronization [None req-d249cac7-8b93-459e-bdde-7a06ff540049 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_rules [ 1217.819597] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_rules [ 1217.819926] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.820066] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.820136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.820388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.820473] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.891971] env[69777]: INFO networking_nsxv3.common.synchronization [None req-7aa5d92f-4c40-429d-b12c-edad926e3365 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_rules [ 1217.892623] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_rules [ 1217.892956] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.893075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.261947] env[69777]: INFO networking_nsxv3.common.synchronization [req-c02aa110-e027-48fd-870d-7b44805f959c req-46f47820-4e2f-4c28-bb93-845ffdbf4e6e tempest-ServersTestJSON-1468905784 tempest-ServersTestJSON-1468905784-project-member] Enqueued Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1218.262562] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 with Priority: HIGHEST for action security_group_members [ 1218.262872] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.263010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.263085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.263292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.263447] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.263547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.263610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.263757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.263880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.263919] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06bee688-2b64-4a9b-b0eb-ee4c735a9c41',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.347106] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.347253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.347329] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.347562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.347665] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.347768] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 already deleted. [ 1218.347852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.348035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.348222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.348307] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.768900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.768900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.768900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.768900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.768900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.768900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.768900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.768900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.768900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.768900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.768900] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 is going to be updated. [ 1218.802009] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.802209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.802278] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.802445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.802586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.815426] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: IN_PROGRESS for 2s [ 1218.869426] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.869722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.869722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.869843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.869934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.870041] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 already deleted. [ 1218.870132] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.340639] env[69777]: INFO networking_nsxv3.common.synchronization [req-fff0245b-4b1c-41f8-952e-1d2becce0dc8 req-193a11ae-3129-442a-bb33-9dcab5c7e317 tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1219.341160] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1219.341468] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.341592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.341659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.341851] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.341990] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.342342] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.342456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.342667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.342842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.343309] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.654551] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.654758] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.654889] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.655182] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.655447] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.655609] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.655730] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.655943] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.656105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.656337] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.656454] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.656680] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.656680] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.656801] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.656891] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.657033] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.678484] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.678683] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1219.678824] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.679021] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.679375] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-474b7ae7-eced-4ae9-85e6-817d0efa3453 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.679563] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-474b7ae7-eced-4ae9-85e6-817d0efa3453" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.679687] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-474b7ae7-eced-4ae9-85e6-817d0efa3453" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.680064] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-474b7ae7-eced-4ae9-85e6-817d0efa3453" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.680225] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('474b7ae7-eced-4ae9-85e6-817d0efa3453',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.845963] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.846197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.846197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.846416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.846512] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.846714] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.846810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.846874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.847032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.847111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.847202] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be updated. [ 1219.874019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.874330] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.874330] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.874420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.874497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.882607] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: IN_PROGRESS for 2s [ 1220.183553] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.183797] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.183930] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.184243] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.184405] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.184629] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 474b7ae7-eced-4ae9-85e6-817d0efa3453 not found, creating... [ 1220.184922] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.185105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.185230] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.185452] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.185596] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.185882] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.186054] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.186201] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.186422] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.186572] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.186738] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 474b7ae7-eced-4ae9-85e6-817d0efa3453 is going to be created. [ 1220.204491] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.204695] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.204839] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.205142] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.205318] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.205544] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-474b7ae7-eced-4ae9-85e6-817d0efa3453" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.824491] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 in Status: SUCCESS [ 1220.824663] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06bee688-2b64-4a9b-b0eb-ee4c735a9c41 deletion is rescheduled due to dependency. [ 1220.824786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06bee688-2b64-4a9b-b0eb-ee4c735a9c41" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.868339] env[69777]: INFO networking_nsxv3.common.synchronization [req-fff0245b-4b1c-41f8-952e-1d2becce0dc8 req-dd1a07ae-8f13-4a09-81e3-2ba33a7ba555 service nova] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_rules [ 1220.868442] env[69777]: INFO networking_nsxv3.common.synchronization [req-fff0245b-4b1c-41f8-952e-1d2becce0dc8 req-dd1a07ae-8f13-4a09-81e3-2ba33a7ba555 service nova] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1220.868583] env[69777]: INFO networking_nsxv3.common.synchronization [req-fff0245b-4b1c-41f8-952e-1d2becce0dc8 req-dd1a07ae-8f13-4a09-81e3-2ba33a7ba555 service nova] Enqueued Resource ID: 474b7ae7-eced-4ae9-85e6-817d0efa3453 with Priority: HIGHEST for action port [ 1220.868815] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_rules [ 1220.868936] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1220.869057] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 474b7ae7-eced-4ae9-85e6-817d0efa3453 with Priority: HIGHEST for action port [ 1220.869626] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.869749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.869819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.871064] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.871249] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.872382] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.872539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.872853] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-474b7ae7-eced-4ae9-85e6-817d0efa3453 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.873017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-474b7ae7-eced-4ae9-85e6-817d0efa3453" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.873128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-474b7ae7-eced-4ae9-85e6-817d0efa3453" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.873379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-474b7ae7-eced-4ae9-85e6-817d0efa3453" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.873503] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('474b7ae7-eced-4ae9-85e6-817d0efa3453',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.375887] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.376168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.376219] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 474b7ae7-eced-4ae9-85e6-817d0efa3453 with status ACTIVE [ 1221.376390] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.376513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.376551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.376757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.376842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.377028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.377128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.377201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.377350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.377532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.377598] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.377691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.377750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.377886] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.377957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.378053] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 474b7ae7-eced-4ae9-85e6-817d0efa3453 is going to be updated. [ 1221.397570] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.397765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.397817] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.398025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.398201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.398380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-474b7ae7-eced-4ae9-85e6-817d0efa3453" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.556138] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a1d1d99-2005-45dd-8d31-ad7bc367f217 req-d9234c0c-1423-4214-ac9e-ec52fae3e2b4 tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1221.556510] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1221.556816] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.556931] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.556995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.557220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.557368] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.557460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.557540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.557693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.557773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.557862] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.888791] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.889073] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.889239] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.889481] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.889753] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.889910] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.890040] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.890260] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.890411] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.890620] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.890737] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1221.890846] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1221.890955] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1221.891077] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1221.891273] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1221.891425] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1221.893082] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 1221.893247] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e deletion is rescheduled due to dependency. [ 1221.893346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.893809] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.893976] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.894143] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.894244] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.894297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.894440] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.894528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.894599] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.911237] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1221.911407] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1221.911551] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1221.911716] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.912010] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-077bf66c-e16c-41f6-a72b-47753c0a2358 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.912195] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-077bf66c-e16c-41f6-a72b-47753c0a2358" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.912356] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-077bf66c-e16c-41f6-a72b-47753c0a2358" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.912648] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-077bf66c-e16c-41f6-a72b-47753c0a2358" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.912785] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('077bf66c-e16c-41f6-a72b-47753c0a2358',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.059719] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.059719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.059719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.059896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.060013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.060243] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.060360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.060360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.060521] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.060597] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.060685] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1222.084514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.084695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.084737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.084882] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.085024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.094429] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1222.396888] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.415668] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.415905] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.416049] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.416346] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.416499] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.416658] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 077bf66c-e16c-41f6-a72b-47753c0a2358 not found, creating... [ 1222.416923] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.417095] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.417219] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.417441] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.417589] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.417882] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.418051] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.418174] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.418404] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.418582] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.418734] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 077bf66c-e16c-41f6-a72b-47753c0a2358 is going to be created. [ 1222.437708] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.437941] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.438077] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.438317] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.438543] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.438760] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-077bf66c-e16c-41f6-a72b-47753c0a2358" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.899232] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.111376] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a1d1d99-2005-45dd-8d31-ad7bc367f217 req-270bd62c-ec75-426f-8177-aef2394af766 service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 1223.111550] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a1d1d99-2005-45dd-8d31-ad7bc367f217 req-270bd62c-ec75-426f-8177-aef2394af766 service nova] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1223.111692] env[69777]: INFO networking_nsxv3.common.synchronization [req-2a1d1d99-2005-45dd-8d31-ad7bc367f217 req-270bd62c-ec75-426f-8177-aef2394af766 service nova] Enqueued Resource ID: 077bf66c-e16c-41f6-a72b-47753c0a2358 with Priority: HIGHEST for action port [ 1223.112198] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_rules [ 1223.112658] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1223.112830] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 077bf66c-e16c-41f6-a72b-47753c0a2358 with Priority: HIGHEST for action port [ 1223.113457] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.113642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.113751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.114033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.114160] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.115013] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.115170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.115411] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-077bf66c-e16c-41f6-a72b-47753c0a2358 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.115557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-077bf66c-e16c-41f6-a72b-47753c0a2358" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.115661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-077bf66c-e16c-41f6-a72b-47753c0a2358" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.115863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-077bf66c-e16c-41f6-a72b-47753c0a2358" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.115983] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('077bf66c-e16c-41f6-a72b-47753c0a2358',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.404012] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.404012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.404351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.404351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.404413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.404507] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be updated. [ 1223.432450] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.432601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.432651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.432865] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.433375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.442206] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: IN_PROGRESS for 2s [ 1223.617572] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.617743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.620065] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 077bf66c-e16c-41f6-a72b-47753c0a2358 with status ACTIVE [ 1223.620248] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.620370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.620441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.620646] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.620735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.620928] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.620995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.621068] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.621248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.621315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.621518] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.621610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.621673] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.621820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.621896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.621981] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 077bf66c-e16c-41f6-a72b-47753c0a2358 is going to be updated. [ 1223.657171] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.657309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.657374] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.657569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.657699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.657853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-077bf66c-e16c-41f6-a72b-47753c0a2358" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.103211] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1224.103510] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 1224.103680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.103815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.104036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.104231] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.104352] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.104419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.104617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.104671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.104721] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.606868] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.109610] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.452507] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 1225.452766] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.453067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.453255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.453499] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.453645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.453713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.453965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.454067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.454183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.454283] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.613152] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.613547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.613547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.613547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.613653] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.613725] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1225.640650] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.640839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.640839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.641045] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.641221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.648592] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1225.957166] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.459727] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d94c1310-5466-4ce7-9d83-c7c474aa637e: rpc.has_security_group_logging(os_id): False [ 1226.476908] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.477107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.477163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.477338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.477431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.477707] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.477813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.477875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.478037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.478118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.478207] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be updated. [ 1226.529791] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.529943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.530015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.530258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.530422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.541133] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: IN_PROGRESS for 2s [ 1227.658167] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1227.659130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.659130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.659130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.659130] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.659130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.659130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.659393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.659393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.659462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.659559] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.114056] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1228.114174] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1228.161982] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.162334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.162446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.162710] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.162977] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.163155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.163277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.163564] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.163712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.163859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.164196] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.164315] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.164543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.164613] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.164865] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.164958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.165090] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.165322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.165461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.165609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.165772] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.554890] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 1228.554890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.669477] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44fd483-f70f-4a69-967b-e48536b42565: rpc.has_security_group_logging(os_id): False [ 1228.686621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.686773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.686845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.687173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.687294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.687845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.687845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.687845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.687845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.687845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.688077] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.688183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.688183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.688327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.688401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.688583] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.688727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.688799] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.688943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.689036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.689125] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1228.768156] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.768308] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.768384] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.768602] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.768753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.792905] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1230.281549] env[69777]: INFO networking_nsxv3.common.synchronization [None req-3b31e5d3-891a-4c25-9934-038721cf6fae None None] Enqueued Resource ID: eb481f17-ad04-485d-88ab-365183226b9d with Priority: HIGHEST for action port [ 1230.281549] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb481f17-ad04-485d-88ab-365183226b9d with Priority: HIGHEST for action port [ 1230.282325] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb481f17-ad04-485d-88ab-365183226b9d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.282325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb481f17-ad04-485d-88ab-365183226b9d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.282325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb481f17-ad04-485d-88ab-365183226b9d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.284069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb481f17-ad04-485d-88ab-365183226b9d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.284069] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb481f17-ad04-485d-88ab-365183226b9d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.785401] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb481f17-ad04-485d-88ab-365183226b9d [ 1230.787992] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.788245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.788323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.788546] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.788964] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.789486] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb481f17-ad04-485d-88ab-365183226b9d already deleted. [ 1230.789486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb481f17-ad04-485d-88ab-365183226b9d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.809396] env[69777]: INFO networking_nsxv3.common.synchronization [None req-4569ef02-755a-4443-9f84-bcceb7aa0652 tempest-AttachVolumeTestJSON-202711453 tempest-AttachVolumeTestJSON-202711453-project-member] Enqueued Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_rules [ 1230.809979] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1230.810481] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.810968] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_rules [ 1230.811328] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.811645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.811645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.812108] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.812108] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.923539] env[69777]: INFO networking_nsxv3.common.synchronization [None req-e0cf8d07-b27a-4a83-b1d1-fd070174306c tempest-AttachVolumeTestJSON-202711453 tempest-AttachVolumeTestJSON-202711453-project-member] Enqueued Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_rules [ 1230.923539] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_rules [ 1230.923539] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.923539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.335840] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.335840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.335840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.335840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.335840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.335840] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 already deleted. [ 1231.335840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.335840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.335840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.335840] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.794354] env[69777]: INFO networking_nsxv3.common.synchronization [req-875a6453-45a4-4dd1-bbdd-f05669a5e878 req-762aa6ae-6387-4e84-8cfe-9dc93a1bbf72 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1231.795027] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1231.795236] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.795370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.795441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.795708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.795860] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.795962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.796457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.796650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.796835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.796835] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.858183] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.858331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.858405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.858619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.858708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.858811] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 already deleted. [ 1231.858890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.126541] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.126743] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.126873] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.127168] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.127792] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.127974] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.128114] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.128349] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.128528] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.128749] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1232.128868] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1232.128982] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1232.129116] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1232.129234] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1232.129348] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1232.129488] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1232.146473] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1232.146657] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1232.146806] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1232.146971] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.147268] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-01ab5f63-a652-4296-9346-be2e3fe43cb5 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.147435] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-01ab5f63-a652-4296-9346-be2e3fe43cb5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.147556] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-01ab5f63-a652-4296-9346-be2e3fe43cb5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.147843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-01ab5f63-a652-4296-9346-be2e3fe43cb5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.147985] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01ab5f63-a652-4296-9346-be2e3fe43cb5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.194248] env[69777]: INFO networking_nsxv3.common.synchronization [None req-7db39d57-1f9c-4780-bd68-a664e94d49d6 None None] Enqueued Resource ID: 9b82bdbc-80c6-41a3-b04c-1c0598807fe6 with Priority: HIGHEST for action port [ 1232.195028] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b82bdbc-80c6-41a3-b04c-1c0598807fe6 with Priority: HIGHEST for action port [ 1232.196013] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b82bdbc-80c6-41a3-b04c-1c0598807fe6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.196275] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b82bdbc-80c6-41a3-b04c-1c0598807fe6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.196366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b82bdbc-80c6-41a3-b04c-1c0598807fe6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.196622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b82bdbc-80c6-41a3-b04c-1c0598807fe6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.196883] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b82bdbc-80c6-41a3-b04c-1c0598807fe6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.299409] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.299602] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.299602] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.299786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.299874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.300087] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.300183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.300247] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.300389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.300462] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.300548] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 already deleted. [ 1232.300627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.650425] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.650698] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.650863] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.651163] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.651363] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.651528] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 01ab5f63-a652-4296-9346-be2e3fe43cb5 not found, creating... [ 1232.651790] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.651955] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.652093] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.652325] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.652471] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.652759] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.652919] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.653052] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.653267] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.653407] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.653549] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 01ab5f63-a652-4296-9346-be2e3fe43cb5 is going to be created. [ 1232.674908] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.675159] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.675277] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.675539] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.675775] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.676016] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-01ab5f63-a652-4296-9346-be2e3fe43cb5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.698551] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b82bdbc-80c6-41a3-b04c-1c0598807fe6 [ 1232.698763] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.698888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.698958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.699207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.699301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.699399] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b82bdbc-80c6-41a3-b04c-1c0598807fe6 already deleted. [ 1232.699481] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b82bdbc-80c6-41a3-b04c-1c0598807fe6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.352371] env[69777]: INFO networking_nsxv3.common.synchronization [req-875a6453-45a4-4dd1-bbdd-f05669a5e878 req-10021e60-a7e7-46c3-a7ab-aaf82e0c38a5 service nova] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_rules [ 1233.352571] env[69777]: INFO networking_nsxv3.common.synchronization [req-875a6453-45a4-4dd1-bbdd-f05669a5e878 req-10021e60-a7e7-46c3-a7ab-aaf82e0c38a5 service nova] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1233.352731] env[69777]: INFO networking_nsxv3.common.synchronization [req-875a6453-45a4-4dd1-bbdd-f05669a5e878 req-10021e60-a7e7-46c3-a7ab-aaf82e0c38a5 service nova] Enqueued Resource ID: 01ab5f63-a652-4296-9346-be2e3fe43cb5 with Priority: HIGHEST for action port [ 1233.353243] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_rules [ 1233.353383] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1233.353514] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01ab5f63-a652-4296-9346-be2e3fe43cb5 with Priority: HIGHEST for action port [ 1233.353741] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.353857] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.353925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.354192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.354232] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.355402] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.355517] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.355585] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.355746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.355888] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.355982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.356059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.356203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.356304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.356388] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.357087] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-01ab5f63-a652-4296-9346-be2e3fe43cb5 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.357194] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01ab5f63-a652-4296-9346-be2e3fe43cb5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.357249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01ab5f63-a652-4296-9346-be2e3fe43cb5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.357449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01ab5f63-a652-4296-9346-be2e3fe43cb5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.357500] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01ab5f63-a652-4296-9346-be2e3fe43cb5',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.863312] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.863312] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.863312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.863312] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01ab5f63-a652-4296-9346-be2e3fe43cb5 with status ACTIVE [ 1233.863312] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.863312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.863312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.863312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.863312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.863312] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.863312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.863312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.863312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.863312] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.863980] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.863980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.868704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.868704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.868704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.868704] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01ab5f63-a652-4296-9346-be2e3fe43cb5 is going to be updated. [ 1233.887747] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.887747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.887747] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.888185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.888185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.888306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01ab5f63-a652-4296-9346-be2e3fe43cb5" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.370121] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.872555] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.872986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.872986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.872986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.873221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.873221] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 is going to be created. [ 1234.897973] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.898146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.898232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.898456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.898613] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.907482] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: UNINITIALIZED for 2s [ 1236.918965] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: SUCCESS [ 1236.919334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.919406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.919636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.919859] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.920012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.920104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.920307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.920411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.920518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.920629] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.422565] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.638864] env[69777]: INFO networking_nsxv3.common.synchronization [req-13e82462-8b48-44b2-88fe-beabad165bb6 req-f43113a5-aa85-455b-88e0-607762c474df tempest-ServerActionsTestOtherB-1106354566 tempest-ServerActionsTestOtherB-1106354566-project-member] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1237.639473] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1237.639829] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.640036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.642683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.642683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.642683] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.642683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.642683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.642683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.642683] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.642683] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.879758] env[69777]: INFO networking_nsxv3.common.synchronization [req-8deac936-f948-4b80-820e-717c21a077f6 req-6090d249-92fa-4d39-bccc-6e090e2741b8 tempest-AttachVolumeTestJSON-202711453 tempest-AttachVolumeTestJSON-202711453-project-member] Enqueued Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_members [ 1237.880315] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_members [ 1237.880632] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11a036c-e695-48d0-bc8a-32f7a8cd8485 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.880753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.880824] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.882343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.882343] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.882343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.882343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.882582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.882708] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.882844] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.925085] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 321cefa0-5927-4827-bb54-946d4d4296b8: rpc.has_security_group_logging(os_id): False [ 1237.941832] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.942033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.942255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.942483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.942572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.942818] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.942918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.943104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.943165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.943213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.943300] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 is going to be created. [ 1237.996383] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.996647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.996761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.997095] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.997351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.008249] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: IN_PROGRESS for 2s [ 1238.130915] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.131192] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-435" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.131389] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-435" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.131744] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-435" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.132069] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.132317] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.132476] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.132738] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.132901] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.133154] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1238.133320] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1238.133430] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1238.133534] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1238.134076] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1238.134076] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1238.134076] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1238.144596] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.144720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.144809] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.144925] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.151585] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1238.151739] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1238.151878] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1238.152054] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-435" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.152327] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-c709a657-a402-4fd1-b273-83815d693c3d taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.152488] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-c709a657-a402-4fd1-b273-83815d693c3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.152612] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-c709a657-a402-4fd1-b273-83815d693c3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.152878] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-c709a657-a402-4fd1-b273-83815d693c3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.153029] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c709a657-a402-4fd1-b273-83815d693c3d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.163875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.164077] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.164196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.164254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.164390] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.164468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.164551] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 1238.198153] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.198792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.199047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.199233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.199389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.208037] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1238.385219] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.385385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.385460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.385717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.385836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.386051] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.386151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.386218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.386367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.386467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.386560] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 already deleted. [ 1238.386643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.590569] env[69777]: INFO networking_nsxv3.common.synchronization [req-cb626492-6118-4241-ae4c-20f8baa87783 req-acebacc0-8e47-400b-82c8-d4d291b7cd82 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_members [ 1238.591100] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGHEST for action security_group_members [ 1238.591431] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2cbd17-afe0-45e7-973d-4380ccd03877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.592209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.592209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.592209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.592209] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.592209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.592209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.592707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.592707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.592707] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.656495] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.656725] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.656854] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.657140] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.657294] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.657452] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port c709a657-a402-4fd1-b273-83815d693c3d not found, creating... [ 1238.657744] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.657919] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.657977] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.658212] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.658444] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.658604] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.658812] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.658945] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.665521] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.665521] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.665521] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: c709a657-a402-4fd1-b273-83815d693c3d is going to be created. [ 1238.684797] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.685034] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.685178] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.685449] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.685687] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.686246] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-c709a657-a402-4fd1-b273-83815d693c3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.094532] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.094818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.094818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.094981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.095088] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.095286] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.095382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.095441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.095740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.095740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.095740] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 is going to be updated. [ 1239.118763] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.118907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.119019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.119178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.119399] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.126707] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 in Status: IN_PROGRESS for 2s [ 1239.383009] env[69777]: INFO networking_nsxv3.common.synchronization [req-8deac936-f948-4b80-820e-717c21a077f6 req-ce49cfcf-d608-4ba6-9420-2480a6091ab9 service nova] Enqueued Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_rules [ 1239.383482] env[69777]: INFO networking_nsxv3.common.synchronization [req-8deac936-f948-4b80-820e-717c21a077f6 req-ce49cfcf-d608-4ba6-9420-2480a6091ab9 service nova] Enqueued Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_members [ 1239.383482] env[69777]: INFO networking_nsxv3.common.synchronization [req-8deac936-f948-4b80-820e-717c21a077f6 req-ce49cfcf-d608-4ba6-9420-2480a6091ab9 service nova] Enqueued Resource ID: c709a657-a402-4fd1-b273-83815d693c3d with Priority: HIGHEST for action port [ 1239.383774] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_rules [ 1239.383774] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_members [ 1239.383899] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c709a657-a402-4fd1-b273-83815d693c3d with Priority: HIGHEST for action port [ 1239.384427] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.385037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.385037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.385037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.385037] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.385845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11a036c-e695-48d0-bc8a-32f7a8cd8485 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.385845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.386015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.386075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.386350] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.386350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.386350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.386697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.386697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.386697] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.387802] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-c709a657-a402-4fd1-b273-83815d693c3d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.387802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c709a657-a402-4fd1-b273-83815d693c3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.387802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c709a657-a402-4fd1-b273-83815d693c3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.388018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c709a657-a402-4fd1-b273-83815d693c3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.388056] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c709a657-a402-4fd1-b273-83815d693c3d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.891028] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11a036c-e695-48d0-bc8a-32f7a8cd8485 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.891028] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.892811] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.892811] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c709a657-a402-4fd1-b273-83815d693c3d with status ACTIVE [ 1239.892811] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.892811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.892811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.893261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.893261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.893369] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.893430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.893573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.893658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.894514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.894514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.894514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.894514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.894514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.894514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.894514] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c709a657-a402-4fd1-b273-83815d693c3d is going to be updated. [ 1239.914204] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.914333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.914411] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.914630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.914782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.914963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c709a657-a402-4fd1-b273-83815d693c3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.028431] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: SUCCESS [ 1240.028664] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.217594] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1240.217856] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 deletion is rescheduled due to dependency. [ 1240.217912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.396762] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.899530] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.899715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.899812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.900183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.900183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.900301] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 is going to be created. [ 1240.920722] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.920853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.920927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.921217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.921448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.930653] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 in Status: UNINITIALIZED for 2s [ 1241.135606] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 in Status: SUCCESS [ 1241.135830] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 deletion is rescheduled due to dependency. [ 1241.135946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.947478] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 in Status: SUCCESS [ 1242.947785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.947842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.948092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.948300] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.948458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.948458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.948619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.948699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.948784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.948876] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.450892] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.953182] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d11a036c-e695-48d0-bc8a-32f7a8cd8485: rpc.has_security_group_logging(os_id): False [ 1243.970386] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.970530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.970575] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.970798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.970928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.971164] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.971264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.971394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.971557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.972044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.972044] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 is going to be created. [ 1244.024227] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.024423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.024518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.024761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.024950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.034346] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 in Status: IN_PROGRESS for 2s [ 1244.385148] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1244.385258] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1245.973618] env[69777]: INFO networking_nsxv3.common.synchronization [req-487430c9-f96d-4577-907a-eb14937689b8 req-e6d4b53b-cb22-4a7d-8f87-d93b3ea33cac tempest-ServerActionsTestOtherB-1106354566 tempest-ServerActionsTestOtherB-1106354566-project-member] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1245.973618] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1245.973618] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.973618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.973618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.973618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.973618] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.976116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.976302] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.978933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.978933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.978933] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.045906] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 in Status: SUCCESS [ 1246.046158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.283143] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.283972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.283972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.283972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.283972] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.284196] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.284243] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.284875] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.284875] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.284875] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.284875] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.285098] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.285138] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.285235] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.285340] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.285529] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.305432] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.305609] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1246.305751] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.307051] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.307051] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-9c75e83a-76df-4b02-a52b-58dd3aa6441e taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.307051] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.307051] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.307051] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.307051] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c75e83a-76df-4b02-a52b-58dd3aa6441e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.480529] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.480529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.480765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.480862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.480924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.481743] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.481743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.481743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.481743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.481743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.481743] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 1246.505780] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.505979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.505979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.506167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.506310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.515233] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1246.809839] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.810086] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.810219] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.810496] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.810658] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.810820] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 9c75e83a-76df-4b02-a52b-58dd3aa6441e not found, creating... [ 1246.811128] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.811307] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.811615] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.811721] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.811888] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.812210] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.812543] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.812543] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.812785] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.812930] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.813084] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 9c75e83a-76df-4b02-a52b-58dd3aa6441e is going to be created. [ 1246.833712] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.834031] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.834031] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.834279] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.834658] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.834898] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.537053] env[69777]: INFO networking_nsxv3.common.synchronization [req-487430c9-f96d-4577-907a-eb14937689b8 req-dfed543f-cb5e-4502-88b0-2361bd5428e8 service nova] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 1247.537324] env[69777]: INFO networking_nsxv3.common.synchronization [req-487430c9-f96d-4577-907a-eb14937689b8 req-dfed543f-cb5e-4502-88b0-2361bd5428e8 service nova] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1247.537446] env[69777]: INFO networking_nsxv3.common.synchronization [req-487430c9-f96d-4577-907a-eb14937689b8 req-dfed543f-cb5e-4502-88b0-2361bd5428e8 service nova] Enqueued Resource ID: 9c75e83a-76df-4b02-a52b-58dd3aa6441e with Priority: HIGHEST for action port [ 1247.538048] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 1247.538311] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1247.538458] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c75e83a-76df-4b02-a52b-58dd3aa6441e with Priority: HIGHEST for action port [ 1247.538782] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.538910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.538997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.539250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.539340] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.540791] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.540893] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.541145] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c75e83a-76df-4b02-a52b-58dd3aa6441e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.541210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.541280] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.541461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.541544] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c75e83a-76df-4b02-a52b-58dd3aa6441e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.043017] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.043165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.043370] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c75e83a-76df-4b02-a52b-58dd3aa6441e with status ACTIVE [ 1248.043538] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.043650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.043715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.043928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.044027] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.044203] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.044298] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.044362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.044623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.044623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.044767] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.044872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.044935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.045083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.045165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.045249] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c75e83a-76df-4b02-a52b-58dd3aa6441e is going to be updated. [ 1248.065822] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.065953] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.066033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.066234] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.066367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.066516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.187296] env[69777]: INFO networking_nsxv3.common.synchronization [req-d3283adb-9fb8-488f-aeca-7e225034b227 req-2e27e22b-79d9-402f-a3ae-75dc3481e2fa tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1248.187906] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1248.188317] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.188471] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.188756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.188843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.188942] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.191071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.191071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.191071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.191071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.191071] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.482955] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.482955] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.483195] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.483491] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.483758] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.483980] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.484154] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.484411] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.484594] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.484838] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.484980] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1248.485133] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1248.485289] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1248.485425] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.485563] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1248.485732] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1248.503685] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1248.503822] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1248.504018] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1248.504258] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.504577] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-bf0b3632-b0cf-4a95-adba-0c98a84e82bd taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.504800] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-bf0b3632-b0cf-4a95-adba-0c98a84e82bd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.504946] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-bf0b3632-b0cf-4a95-adba-0c98a84e82bd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.505300] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-bf0b3632-b0cf-4a95-adba-0c98a84e82bd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.505476] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0b3632-b0cf-4a95-adba-0c98a84e82bd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.522181] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1248.522392] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 deletion is rescheduled due to dependency. [ 1248.522652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.522807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.523018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.523197] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.523326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.523410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.523552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.523656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.523720] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.692584] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.007579] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.007814] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.007946] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.008264] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.008425] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.008588] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port bf0b3632-b0cf-4a95-adba-0c98a84e82bd not found, creating... [ 1249.008850] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.009015] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.009141] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.009537] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.009810] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.010220] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.010435] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.010601] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.010876] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.011072] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.011263] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: bf0b3632-b0cf-4a95-adba-0c98a84e82bd is going to be created. [ 1249.025614] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.030241] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.030241] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.030372] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.030725] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.031043] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.031363] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-bf0b3632-b0cf-4a95-adba-0c98a84e82bd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.195416] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.529101] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.698102] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.698528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.698528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.698528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.698528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.698692] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 is going to be updated. [ 1249.726664] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.726765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.726876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.727436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.727619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.731935] env[69777]: INFO networking_nsxv3.common.synchronization [req-d3283adb-9fb8-488f-aeca-7e225034b227 req-9583f8f7-bb5b-4fdb-8390-ee2a2f7aa5c3 service nova] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_rules [ 1249.732187] env[69777]: INFO networking_nsxv3.common.synchronization [req-d3283adb-9fb8-488f-aeca-7e225034b227 req-9583f8f7-bb5b-4fdb-8390-ee2a2f7aa5c3 service nova] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1249.732474] env[69777]: INFO networking_nsxv3.common.synchronization [req-d3283adb-9fb8-488f-aeca-7e225034b227 req-9583f8f7-bb5b-4fdb-8390-ee2a2f7aa5c3 service nova] Enqueued Resource ID: bf0b3632-b0cf-4a95-adba-0c98a84e82bd with Priority: HIGHEST for action port [ 1249.733125] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_rules [ 1249.733295] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1249.733438] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf0b3632-b0cf-4a95-adba-0c98a84e82bd with Priority: HIGHEST for action port [ 1249.733739] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.733880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.733963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.734192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.734276] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.735111] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.735254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.735569] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf0b3632-b0cf-4a95-adba-0c98a84e82bd taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.735706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf0b3632-b0cf-4a95-adba-0c98a84e82bd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.735773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf0b3632-b0cf-4a95-adba-0c98a84e82bd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.735959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf0b3632-b0cf-4a95-adba-0c98a84e82bd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.736043] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0b3632-b0cf-4a95-adba-0c98a84e82bd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.738232] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: IN_PROGRESS for 2s [ 1250.034142] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.034142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.034142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.034142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.034142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.034142] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 1250.059223] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.059223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.059223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.059223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.059223] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.065937] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1250.150023] env[69777]: INFO networking_nsxv3.common.synchronization [req-d2cb30c7-7ae8-44cc-80cd-1de79cdbc348 req-55e5ab62-263e-43b6-9639-83bd34eef4c0 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_members [ 1250.150526] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGHEST for action security_group_members [ 1250.152456] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-50bad828-a4cc-463b-9c54-306ad5358f8d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.152456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.152456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.152456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.152456] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.152456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.152456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.152456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.152456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.152456] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.238239] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.238355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.238456] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf0b3632-b0cf-4a95-adba-0c98a84e82bd with status ACTIVE [ 1250.238622] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.238728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.238794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.239059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.239174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.239358] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.239495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.239577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.239741] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.239842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.240016] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.240101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.240254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.240304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.240360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.240446] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf0b3632-b0cf-4a95-adba-0c98a84e82bd is going to be updated. [ 1250.258624] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.258793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.258835] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.259074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.259236] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.259441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf0b3632-b0cf-4a95-adba-0c98a84e82bd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.655354] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.655560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.655560] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.656825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.674454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.678166] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.678332] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.678398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.678605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.678696] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.678853] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50bad828-a4cc-463b-9c54-306ad5358f8d is going to be updated. [ 1250.702254] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.702579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.702579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.702703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.702805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.710503] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bad828-a4cc-463b-9c54-306ad5358f8d in Status: IN_PROGRESS for 2s [ 1251.753582] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: SUCCESS [ 1251.753965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.754184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.754413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.754611] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.754734] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.754802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.755024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.755096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.755200] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.074777] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1252.075013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.075183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.075484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.075682] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.075802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.075870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.076041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.076124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.076211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.076302] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.258322] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.578603] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.718746] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bad828-a4cc-463b-9c54-306ad5358f8d in Status: IN_PROGRESS for 4s [ 1252.760206] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.081225] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd51d8a4-0c41-4e95-a3e3-1f0da556ee84: rpc.has_security_group_logging(os_id): False [ 1253.099067] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.099218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.099280] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.099489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.099579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.099836] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.099934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.099993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.100155] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.100229] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.100314] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 1253.164063] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.164269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.164269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.164484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.164633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.181984] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1253.262922] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.263101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.263179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.263392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.263486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.263588] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 is going to be updated. [ 1253.299249] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.299615] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.299709] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.299946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.300141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.308457] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: IN_PROGRESS for 2s [ 1254.728299] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bad828-a4cc-463b-9c54-306ad5358f8d in Status: SUCCESS [ 1254.728655] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50bad828-a4cc-463b-9c54-306ad5358f8d deletion is rescheduled due to dependency. [ 1254.728655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.846247] env[69777]: INFO networking_nsxv3.common.synchronization [None req-35684151-c5cf-4924-992d-5ce1a7c05566 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_rules [ 1254.847510] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_rules [ 1254.847580] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.848584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.848584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.848584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.848584] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.931231] env[69777]: INFO networking_nsxv3.common.synchronization [None req-2a3d55b3-023c-44a1-a2b0-1c8380a4b75a tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_rules [ 1254.931403] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_rules [ 1254.931848] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.932133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.196419] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1255.196419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.318178] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: SUCCESS [ 1255.318313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.318544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.318819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.319089] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.319248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.319351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.319584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.319728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.319839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.319947] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.367569] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.367801] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.367801] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.368037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.368131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.368230] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 already deleted. [ 1255.368344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.368489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.368668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.368753] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.824242] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.891038] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.891038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.891293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.891633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.891742] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.891883] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 already deleted. [ 1255.891996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.327197] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 321cefa0-5927-4827-bb54-946d4d4296b8: rpc.has_security_group_logging(os_id): False [ 1256.344236] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.344236] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.344236] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.344418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.344504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.344754] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.344852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.344916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.345073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.345151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.345460] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 is going to be updated. [ 1256.397047] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.397324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.397698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.397989] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.398213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.409412] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: IN_PROGRESS for 2s [ 1256.894469] env[69777]: INFO networking_nsxv3.common.synchronization [req-8edc6191-eb37-495b-aff5-c5ecb65ca0c6 req-2701b4d0-aa0f-49ec-b7a7-464a48f479d3 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 1256.894710] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 1256.895025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.895153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.895220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.895536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.895612] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.895669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.895721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.895867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.895953] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.896060] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.397882] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.900095] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.403101] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.403281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.403355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.403569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.403660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.403821] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 is going to be updated. [ 1258.423664] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: SUCCESS [ 1258.424070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.435659] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.435659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.435797] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.435898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.436094] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.444021] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: IN_PROGRESS for 2s [ 1258.698557] env[69777]: INFO networking_nsxv3.common.synchronization [None req-5808f580-e60f-4958-9906-dd74dbe48c7b tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1258.699152] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1258.699531] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.699674] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.699743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.699947] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.700140] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.700239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.700302] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.700465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.700543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.700646] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.202442] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.202878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.202878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.202963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.202963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.203423] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.203423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.204193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.204193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.204193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.204193] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1259.233965] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.234172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.234253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.234563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.234779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.244250] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1260.148771] env[69777]: INFO networking_nsxv3.common.synchronization [req-6e19e832-f255-4641-acaa-b24fe5904ac4 req-62f7d214-9188-4027-aa39-334c5005e944 tempest-DeleteServersTestJSON-1044693629 tempest-DeleteServersTestJSON-1044693629-project-member] Enqueued Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1260.149349] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44fd483-f70f-4a69-967b-e48536b42565 with Priority: HIGHEST for action security_group_members [ 1260.149652] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44fd483-f70f-4a69-967b-e48536b42565 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.149776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.149844] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.150215] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.150393] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.150524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.150603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.150767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.150855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.150950] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44fd483-f70f-4a69-967b-e48536b42565',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.452878] env[69777]: INFO networking_nsxv3.common.synchronization [req-18486bbb-c2ae-470d-bb7e-6941031e6b9c req-39a44ea7-aa84-4332-9975-420c94cf622e tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_members [ 1260.453873] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: SUCCESS [ 1260.453986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.454361] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_members [ 1260.454671] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a99be3-2c8a-42ba-8c6c-44364c3737d8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.454792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.454856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.455133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.455287] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.455388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.455445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.455596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.455676] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.455767] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.654446] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.654640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.654737] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.655016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.655145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.655395] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.655525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.655618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.655836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.655942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.656099] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 is going to be updated. [ 1260.685017] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.685017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.685017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.685017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.685017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.693478] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: IN_PROGRESS for 2s [ 1260.731018] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.731018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.731018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.731018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.731018] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.731018] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.731341] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.731341] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.731414] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.731620] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1260.731850] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1260.732023] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1260.732161] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1260.732277] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1260.732756] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1260.732756] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1260.751166] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1260.751604] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1260.751604] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1260.751737] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.752125] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-cf995a13-9f52-4cba-927c-3cd8806d76fa taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.752282] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-cf995a13-9f52-4cba-927c-3cd8806d76fa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.752368] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-cf995a13-9f52-4cba-927c-3cd8806d76fa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.752740] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-cf995a13-9f52-4cba-927c-3cd8806d76fa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.752890] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf995a13-9f52-4cba-927c-3cd8806d76fa',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.957862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.958098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.958222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.959026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.959026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.959026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.959026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.959026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.959309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.959309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.959309] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 already deleted. [ 1260.959437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.253796] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1261.254028] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 deletion is rescheduled due to dependency. [ 1261.254124] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.255803] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.256008] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.256144] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.256424] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.256576] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.256729] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port cf995a13-9f52-4cba-927c-3cd8806d76fa not found, creating... [ 1261.256992] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.257163] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.257286] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.257520] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.257666] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.257949] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.258120] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.258244] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.258452] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.258590] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.258730] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: cf995a13-9f52-4cba-927c-3cd8806d76fa is going to be created. [ 1261.285198] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.285424] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.285625] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.285788] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.286126] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.286286] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-cf995a13-9f52-4cba-927c-3cd8806d76fa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.964518] env[69777]: INFO networking_nsxv3.common.synchronization [req-18486bbb-c2ae-470d-bb7e-6941031e6b9c req-1a75d6d8-f095-4f10-a41e-21fc8150e364 service nova] Enqueued Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_rules [ 1261.964518] env[69777]: INFO networking_nsxv3.common.synchronization [req-18486bbb-c2ae-470d-bb7e-6941031e6b9c req-1a75d6d8-f095-4f10-a41e-21fc8150e364 service nova] Enqueued Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_members [ 1261.964518] env[69777]: INFO networking_nsxv3.common.synchronization [req-18486bbb-c2ae-470d-bb7e-6941031e6b9c req-1a75d6d8-f095-4f10-a41e-21fc8150e364 service nova] Enqueued Resource ID: cf995a13-9f52-4cba-927c-3cd8806d76fa with Priority: HIGHEST for action port [ 1261.964963] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_rules [ 1261.965056] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_members [ 1261.965154] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf995a13-9f52-4cba-927c-3cd8806d76fa with Priority: HIGHEST for action port [ 1261.965457] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.965627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.965669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.965916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.966025] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.967494] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a99be3-2c8a-42ba-8c6c-44364c3737d8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.967629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.967702] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.968182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.968182] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.968182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.968450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.968450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.968450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.968550] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.969604] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf995a13-9f52-4cba-927c-3cd8806d76fa taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.969604] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf995a13-9f52-4cba-927c-3cd8806d76fa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.969728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf995a13-9f52-4cba-927c-3cd8806d76fa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.969805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf995a13-9f52-4cba-927c-3cd8806d76fa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.969882] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf995a13-9f52-4cba-927c-3cd8806d76fa',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.471823] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a99be3-2c8a-42ba-8c6c-44364c3737d8 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.472108] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.472223] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.479557] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf995a13-9f52-4cba-927c-3cd8806d76fa with status ACTIVE [ 1262.479557] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.479557] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.479557] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.479557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.479557] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf995a13-9f52-4cba-927c-3cd8806d76fa is going to be updated. [ 1262.508200] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.508348] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.508348] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.508531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.509946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.509946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf995a13-9f52-4cba-927c-3cd8806d76fa" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.702240] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44fd483-f70f-4a69-967b-e48536b42565 in Status: SUCCESS [ 1262.702410] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44fd483-f70f-4a69-967b-e48536b42565 deletion is rescheduled due to dependency. [ 1262.702550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44fd483-f70f-4a69-967b-e48536b42565" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.977738] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.480019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.480176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.480176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.480407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.480506] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.480617] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 is going to be created. [ 1263.503054] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.503242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.503293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.503470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.503633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.512982] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 in Status: UNINITIALIZED for 2s [ 1265.523031] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 in Status: SUCCESS [ 1265.523379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.523418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.523622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.523811] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.523928] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.523993] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.524158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.524239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.524325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.524413] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.026809] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.529406] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81a99be3-2c8a-42ba-8c6c-44364c3737d8: rpc.has_security_group_logging(os_id): False [ 1266.546884] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.547071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.547071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.547901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.547901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.547901] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.547901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.547901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.547901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.548231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.548231] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 is going to be created. [ 1266.600308] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.600451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.600516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.600723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.600898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.609562] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 in Status: IN_PROGRESS for 2s [ 1266.966383] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1266.966493] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1268.621862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 in Status: SUCCESS [ 1268.622172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.950985] env[69777]: INFO networking_nsxv3.common.synchronization [None req-74769771-a5c8-4b10-a292-e8f11a59598f None None] Enqueued Resource ID: 95b056b9-2c8f-4190-a75c-875c4b1dac3d with Priority: HIGHEST for action port [ 1270.952259] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95b056b9-2c8f-4190-a75c-875c4b1dac3d with Priority: HIGHEST for action port [ 1270.953018] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-95b056b9-2c8f-4190-a75c-875c4b1dac3d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.953682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95b056b9-2c8f-4190-a75c-875c4b1dac3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.953682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95b056b9-2c8f-4190-a75c-875c4b1dac3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.953977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95b056b9-2c8f-4190-a75c-875c4b1dac3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.955410] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b056b9-2c8f-4190-a75c-875c4b1dac3d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.457413] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95b056b9-2c8f-4190-a75c-875c4b1dac3d [ 1271.458667] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.460511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.460511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.460511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.460511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.460511] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95b056b9-2c8f-4190-a75c-875c4b1dac3d already deleted. [ 1271.460511] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95b056b9-2c8f-4190-a75c-875c4b1dac3d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.729091] env[69777]: INFO networking_nsxv3.common.synchronization [None req-2fc35a38-458f-4a2d-b45e-2011ecbfaa2f None None] Enqueued Resource ID: 89199700-9cca-4ad4-b500-8239737411ae with Priority: HIGHEST for action port [ 1272.729653] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89199700-9cca-4ad4-b500-8239737411ae with Priority: HIGHEST for action port [ 1272.729969] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-89199700-9cca-4ad4-b500-8239737411ae taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.731502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89199700-9cca-4ad4-b500-8239737411ae" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.731502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89199700-9cca-4ad4-b500-8239737411ae" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.731502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89199700-9cca-4ad4-b500-8239737411ae" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.731502] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89199700-9cca-4ad4-b500-8239737411ae',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.005710] env[69777]: INFO networking_nsxv3.common.synchronization [req-59140656-2210-4860-9e9d-d7e3d484d154 req-c6676f66-5882-40f1-af44-8b2f44596048 tempest-ServerActionsTestOtherA-237730885 tempest-ServerActionsTestOtherA-237730885-project-member] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 1273.005710] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGHEST for action security_group_members [ 1273.006099] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.006282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.006393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.006772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.006845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.007771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.007771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.007771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.007771] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.007771] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.237571] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89199700-9cca-4ad4-b500-8239737411ae [ 1273.237571] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.237735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.237735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.237874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.238587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.238978] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89199700-9cca-4ad4-b500-8239737411ae already deleted. [ 1273.238978] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89199700-9cca-4ad4-b500-8239737411ae" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.509839] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.510061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.510184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.510305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.510400] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.510606] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.510777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.510777] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.510922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.510991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.511439] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 is going to be updated. [ 1273.548019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.548293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.548293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.548454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.548593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.557210] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: IN_PROGRESS for 2s [ 1275.351402] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.351745] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.351795] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.352070] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.352333] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.352488] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.352626] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.352852] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.353008] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.353228] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1275.353342] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1275.353453] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1275.353560] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1275.353671] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1275.353778] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1275.353946] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1275.371393] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1275.371527] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1275.371702] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1275.371875] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.372194] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-2874c46f-4f56-4990-8c25-a90d438df582 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.372327] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.372452] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.372767] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.372913] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2874c46f-4f56-4990-8c25-a90d438df582',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.567021] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 in Status: SUCCESS [ 1275.567021] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 deletion is rescheduled due to dependency. [ 1275.567173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.874994] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.875250] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.875383] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.875687] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.875844] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.876035] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 2874c46f-4f56-4990-8c25-a90d438df582 not found, creating... [ 1275.876282] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.876441] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.876564] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.876784] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.876924] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.877248] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.877381] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.877503] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.877713] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.877853] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.878031] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 2874c46f-4f56-4990-8c25-a90d438df582 is going to be created. [ 1275.896552] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.896756] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.896904] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.897147] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.897375] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.897585] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.582704] env[69777]: INFO networking_nsxv3.common.synchronization [req-1a73d822-0d68-42da-879f-92ffc3f78318 req-dc65a2c7-54f7-4113-b003-4ec67501ec2f service nova] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_rules [ 1276.582704] env[69777]: INFO networking_nsxv3.common.synchronization [req-1a73d822-0d68-42da-879f-92ffc3f78318 req-dc65a2c7-54f7-4113-b003-4ec67501ec2f service nova] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1276.583140] env[69777]: INFO networking_nsxv3.common.synchronization [req-1a73d822-0d68-42da-879f-92ffc3f78318 req-dc65a2c7-54f7-4113-b003-4ec67501ec2f service nova] Enqueued Resource ID: 2874c46f-4f56-4990-8c25-a90d438df582 with Priority: HIGHEST for action port [ 1276.583140] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_rules [ 1276.583210] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1276.583304] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2874c46f-4f56-4990-8c25-a90d438df582 with Priority: HIGHEST for action port [ 1276.583867] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.583985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.586219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.586456] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.586540] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.587515] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.587610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.587610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.587770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.587912] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.588017] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.588083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.588217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.588295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.588381] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.589154] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2874c46f-4f56-4990-8c25-a90d438df582 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.589261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.589314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.589458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.589526] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2874c46f-4f56-4990-8c25-a90d438df582',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.961694] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.961940] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.962075] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.962361] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.962648] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.962838] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.962959] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.963189] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.963343] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.963558] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1276.963673] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1276.963787] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1276.963908] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1276.964050] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1276.964165] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1276.964300] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1276.983778] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1276.983975] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1276.984148] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1276.984352] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-357" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.984696] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-f683730e-0cea-4d44-a1ba-951809ac77e9 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.984875] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.984999] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.985283] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.985423] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f683730e-0cea-4d44-a1ba-951809ac77e9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.092638] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.093412] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.093576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.095085] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2874c46f-4f56-4990-8c25-a90d438df582 with status ACTIVE [ 1277.095186] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.095295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.095351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.095568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.095642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.095795] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.095891] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.095948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.096107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.096184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.096368] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.096460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.096519] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.096818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.096818] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.096818] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2874c46f-4f56-4990-8c25-a90d438df582 is going to be updated. [ 1277.138700] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.138842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.138912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.139120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.139254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.139402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.488165] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.488410] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.488544] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.488827] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.488986] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.489295] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.489459] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.489584] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.489800] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.489963] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.490265] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.490424] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.490547] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.490757] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.490896] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.491053] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: f683730e-0cea-4d44-a1ba-951809ac77e9 is going to be updated. [ 1277.512306] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.512728] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.512869] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.513162] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.513404] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.513662] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.594312] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.097133] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.097133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.097133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.097478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.097478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.097478] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1278.123339] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.123508] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.123566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.123759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.123903] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.131050] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1278.176286] env[69777]: INFO networking_nsxv3.common.synchronization [req-7237a064-b859-4cc5-8463-76e9e225f48f req-e075818c-6d7b-481c-8896-c80b3321f194 service nova] Enqueued Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_rules [ 1278.176462] env[69777]: INFO networking_nsxv3.common.synchronization [req-7237a064-b859-4cc5-8463-76e9e225f48f req-e075818c-6d7b-481c-8896-c80b3321f194 service nova] Enqueued Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_members [ 1278.176604] env[69777]: INFO networking_nsxv3.common.synchronization [req-7237a064-b859-4cc5-8463-76e9e225f48f req-e075818c-6d7b-481c-8896-c80b3321f194 service nova] Enqueued Resource ID: f683730e-0cea-4d44-a1ba-951809ac77e9 with Priority: HIGHEST for action port [ 1278.176836] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_rules [ 1278.176959] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_members [ 1278.177065] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f683730e-0cea-4d44-a1ba-951809ac77e9 with Priority: HIGHEST for action port [ 1278.177592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.177715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.177775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.177971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.178465] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.179662] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.179909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.179909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.180048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.180201] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.180349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.180423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.180582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.180672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.180760] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.183392] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-f683730e-0cea-4d44-a1ba-951809ac77e9 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.183392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.183392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.183392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.183392] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f683730e-0cea-4d44-a1ba-951809ac77e9',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.684372] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f683730e-0cea-4d44-a1ba-951809ac77e9 with status ACTIVE [ 1278.684372] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.684372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.684372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.684874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.684874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.684940] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.685121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.685199] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.685427] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.685541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.685807] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.685942] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.686046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.686251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.686349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.686460] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f683730e-0cea-4d44-a1ba-951809ac77e9 is going to be updated. [ 1278.687794] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.687900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.688100] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.716095] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.716243] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.716295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.716490] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.716649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.716782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f683730e-0cea-4d44-a1ba-951809ac77e9" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.190364] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.441284] env[69777]: INFO networking_nsxv3.common.synchronization [req-2f1decce-f997-4d26-b640-1848096094c3 req-0b56e839-f23c-40bf-aa12-d57383c3ad18 tempest-ServerTagsTestJSON-1257613045 tempest-ServerTagsTestJSON-1257613045-project-member] Enqueued Resource ID: 20d9f07b-22ae-49bd-b703-75678a5c612e with Priority: HIGHEST for action security_group_members [ 1279.441856] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20d9f07b-22ae-49bd-b703-75678a5c612e with Priority: HIGHEST for action security_group_members [ 1279.442197] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-20d9f07b-22ae-49bd-b703-75678a5c612e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.442363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.442401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.442682] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.442780] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.442872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.442946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.447099] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.447204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.447309] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20d9f07b-22ae-49bd-b703-75678a5c612e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.694247] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.694531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.694531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.694719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.694821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.694928] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 is going to be updated. [ 1279.719401] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-953 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.719630] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.719780] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.720139] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.720404] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.720568] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.720689] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.720921] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.721114] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.721359] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.721482] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1279.721625] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1279.721734] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1279.721852] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.721964] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1279.722111] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1279.723867] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.724008] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.724085] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.724242] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.724398] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.733633] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 in Status: IN_PROGRESS for 2s [ 1279.744160] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1279.744331] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1279.744475] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1279.744672] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.744963] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-269091fb-8b55-4692-85ee-1b778d15de32 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.745137] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-269091fb-8b55-4692-85ee-1b778d15de32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.745292] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-269091fb-8b55-4692-85ee-1b778d15de32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.745539] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-269091fb-8b55-4692-85ee-1b778d15de32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.745680] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269091fb-8b55-4692-85ee-1b778d15de32',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.951048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.951048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.951048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.951048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.951048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.951048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.951048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.951048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.951555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.951555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.951555] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20d9f07b-22ae-49bd-b703-75678a5c612e already deleted. [ 1279.951555] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.140746] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1280.140970] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.141144] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.141356] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.141540] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.141712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.141782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.141929] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.142015] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.142138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.142185] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.248570] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.248570] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.248570] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.248766] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.248850] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.248996] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 269091fb-8b55-4692-85ee-1b778d15de32 not found, creating... [ 1280.249274] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.249434] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.249553] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.249775] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.249915] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.250204] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.250362] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.250483] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.250690] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.250831] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.250975] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 269091fb-8b55-4692-85ee-1b778d15de32 is going to be created. [ 1280.268825] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.269008] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.269141] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.269364] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.269609] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.269829] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-269091fb-8b55-4692-85ee-1b778d15de32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.644507] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.644668] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.644736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.644954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.645205] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.645290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.645290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.645453] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.645579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.645678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.645829] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.645923] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.645979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.646137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.646272] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.646364] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.646428] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.646559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.646632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.646713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.646800] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.945994] env[69777]: INFO networking_nsxv3.common.synchronization [req-2f1decce-f997-4d26-b640-1848096094c3 req-58351be7-b072-4c2b-9944-65e9aa34d865 service nova] Enqueued Resource ID: 20d9f07b-22ae-49bd-b703-75678a5c612e with Priority: HIGHEST for action security_group_rules [ 1280.946252] env[69777]: INFO networking_nsxv3.common.synchronization [req-2f1decce-f997-4d26-b640-1848096094c3 req-58351be7-b072-4c2b-9944-65e9aa34d865 service nova] Enqueued Resource ID: 20d9f07b-22ae-49bd-b703-75678a5c612e with Priority: HIGHEST for action security_group_members [ 1280.946349] env[69777]: INFO networking_nsxv3.common.synchronization [req-2f1decce-f997-4d26-b640-1848096094c3 req-58351be7-b072-4c2b-9944-65e9aa34d865 service nova] Enqueued Resource ID: 269091fb-8b55-4692-85ee-1b778d15de32 with Priority: HIGHEST for action port [ 1280.946583] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20d9f07b-22ae-49bd-b703-75678a5c612e with Priority: HIGHEST for action security_group_rules [ 1280.946709] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20d9f07b-22ae-49bd-b703-75678a5c612e with Priority: HIGHEST for action security_group_members [ 1280.946807] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 269091fb-8b55-4692-85ee-1b778d15de32 with Priority: HIGHEST for action port [ 1280.947360] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20d9f07b-22ae-49bd-b703-75678a5c612e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.947482] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.947549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.948385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.948548] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20d9f07b-22ae-49bd-b703-75678a5c612e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.949592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-20d9f07b-22ae-49bd-b703-75678a5c612e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.949751] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.949823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.949994] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.950157] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.950253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.950318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.954662] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.954796] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.954917] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20d9f07b-22ae-49bd-b703-75678a5c612e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.956849] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-269091fb-8b55-4692-85ee-1b778d15de32 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.956965] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-269091fb-8b55-4692-85ee-1b778d15de32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.959114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-269091fb-8b55-4692-85ee-1b778d15de32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.959114] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-269091fb-8b55-4692-85ee-1b778d15de32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.959114] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269091fb-8b55-4692-85ee-1b778d15de32',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.148603] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a80d85d-9154-4a27-bab2-481460122696: rpc.has_security_group_logging(os_id): False [ 1281.169678] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.169863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.169934] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.170129] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.170207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.170406] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.170502] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.170563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.170706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.170803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.170962] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.171071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.171127] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.171264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.171345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.171534] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.171634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.172239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.172239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.172239] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.172239] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1281.237275] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.237527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.237599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.237779] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.237957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.254833] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1281.457806] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20d9f07b-22ae-49bd-b703-75678a5c612e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.460435] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 269091fb-8b55-4692-85ee-1b778d15de32 with status ACTIVE [ 1281.460838] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.460838] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.461169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.461169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.461306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.461386] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.461492] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.461540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.461716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.461793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.461975] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.462104] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.462186] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.462266] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.462328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.462416] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 269091fb-8b55-4692-85ee-1b778d15de32 is going to be updated. [ 1281.463777] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-20d9f07b-22ae-49bd-b703-75678a5c612e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.463885] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.485810] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.485962] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.486046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.486257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.486391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.486547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-269091fb-8b55-4692-85ee-1b778d15de32" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.742431] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 in Status: SUCCESS [ 1281.742652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.742808] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.743019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.743207] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.743316] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.743379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.743520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.743596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.743675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.743759] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.959895] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20d9f07b-22ae-49bd-b703-75678a5c612e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.246242] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.470446] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.470446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.470446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.470446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.470446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.470446] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20d9f07b-22ae-49bd-b703-75678a5c612e is going to be created. [ 1282.510024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.510024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.510024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.510024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.510024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.521735] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20d9f07b-22ae-49bd-b703-75678a5c612e in Status: UNINITIALIZED for 2s [ 1282.749736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f4ac00d-66c7-42bf-aa2f-53b5984883e3: rpc.has_security_group_logging(os_id): False [ 1282.773898] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.774494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.774800] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.777822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.777822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.777822] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.777822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.777822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.777822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.777822] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.777822] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 is going to be updated. [ 1282.843874] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.844098] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.844181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.844448] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.844636] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.857504] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 in Status: IN_PROGRESS for 2s [ 1283.267814] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1283.268109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.531453] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20d9f07b-22ae-49bd-b703-75678a5c612e in Status: SUCCESS [ 1284.531855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.531855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.532245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.532450] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.532591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.532648] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.532812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.532894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.532980] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.533087] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20d9f07b-22ae-49bd-b703-75678a5c612e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.873490] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 in Status: SUCCESS [ 1284.873772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.035524] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-20d9f07b-22ae-49bd-b703-75678a5c612e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.035733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.035733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.035971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.036165] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.036279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.036350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.036473] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.036557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.036645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.036793] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-20d9f07b-22ae-49bd-b703-75678a5c612e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.036883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.037026] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.037125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.037246] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.037333] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.037428] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.037524] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.037759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.037759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.037759] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20d9f07b-22ae-49bd-b703-75678a5c612e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.542766] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20d9f07b-22ae-49bd-b703-75678a5c612e: rpc.has_security_group_logging(os_id): False [ 1285.567663] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.567858] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.567908] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.568172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.569326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.569326] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.569326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.569326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.569326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.569326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.569326] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.569326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.569326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.570202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.570202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.570202] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.570202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.570202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.570202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.570202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.570202] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20d9f07b-22ae-49bd-b703-75678a5c612e is going to be created. [ 1285.623639] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.623896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.623896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.624193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.624391] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.636755] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20d9f07b-22ae-49bd-b703-75678a5c612e in Status: IN_PROGRESS for 2s [ 1285.947877] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.948207] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1287.652035] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20d9f07b-22ae-49bd-b703-75678a5c612e in Status: SUCCESS [ 1287.652371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.948712] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.948972] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1292.155894] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-899 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.155894] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.155894] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.155894] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.155894] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.155894] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.156478] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.156478] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.156478] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.156579] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1292.156708] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.156857] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.156981] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.157055] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1292.157210] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.157355] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.175593] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.175759] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1292.175891] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.176078] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-899" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.176376] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-2874c46f-4f56-4990-8c25-a90d438df582 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.176557] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.176684] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.176961] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.177080] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2874c46f-4f56-4990-8c25-a90d438df582',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.679528] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.680048] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.680384] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.680524] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.680919] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.681230] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.681454] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.681660] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.682100] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.682488] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.682879] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.683134] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.683301] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.683550] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.683728] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.683906] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 2874c46f-4f56-4990-8c25-a90d438df582 is going to be updated. [ 1292.703865] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.704075] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.704210] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.704490] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.704678] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.704893] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.401486] env[69777]: INFO networking_nsxv3.common.synchronization [req-ca2ea4cc-c21d-4175-ae3e-4d39c784521f req-9ca38154-8356-4adb-a098-622ed9308d76 service nova] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_rules [ 1293.401486] env[69777]: INFO networking_nsxv3.common.synchronization [req-ca2ea4cc-c21d-4175-ae3e-4d39c784521f req-9ca38154-8356-4adb-a098-622ed9308d76 service nova] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1293.401816] env[69777]: INFO networking_nsxv3.common.synchronization [req-ca2ea4cc-c21d-4175-ae3e-4d39c784521f req-9ca38154-8356-4adb-a098-622ed9308d76 service nova] Enqueued Resource ID: 2874c46f-4f56-4990-8c25-a90d438df582 with Priority: HIGHEST for action port [ 1293.401816] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_rules [ 1293.401949] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1293.402074] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2874c46f-4f56-4990-8c25-a90d438df582 with Priority: HIGHEST for action port [ 1293.402678] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.402849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.402927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.403141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.403218] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.404078] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.404157] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.404218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.404379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.404526] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.404617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.404672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.404813] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.404892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.404979] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.405679] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2874c46f-4f56-4990-8c25-a90d438df582 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.405776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.405848] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.406461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.406461] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2874c46f-4f56-4990-8c25-a90d438df582',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.907616] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.907761] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.909096] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.909957] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2874c46f-4f56-4990-8c25-a90d438df582 with status ACTIVE [ 1293.910163] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.910276] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.910343] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.910539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.910627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.910795] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.910890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.910954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.911122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.911201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.911375] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.911468] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.911530] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.911667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.911802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.911888] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2874c46f-4f56-4990-8c25-a90d438df582 is going to be updated. [ 1293.933854] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.933995] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.934126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.934386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.934607] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.934795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2874c46f-4f56-4990-8c25-a90d438df582" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.110356] env[69777]: INFO networking_nsxv3.common.synchronization [req-4769517b-36a6-4230-bbd9-aa5909c1b64f req-8c6cc36f-600d-448e-b813-2f701301532a tempest-ServerTagsTestJSON-1257613045 tempest-ServerTagsTestJSON-1257613045-project-member] Enqueued Resource ID: 20d9f07b-22ae-49bd-b703-75678a5c612e with Priority: HIGHEST for action security_group_members [ 1294.110855] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20d9f07b-22ae-49bd-b703-75678a5c612e with Priority: HIGHEST for action security_group_members [ 1294.111183] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-20d9f07b-22ae-49bd-b703-75678a5c612e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.111325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.111359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.111545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.111690] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.111814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.111869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.112032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.112119] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.112211] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20d9f07b-22ae-49bd-b703-75678a5c612e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.417025] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.616389] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.616389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.616389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.616389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.616389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.616389] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.616389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.616389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.616389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.616389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.616389] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20d9f07b-22ae-49bd-b703-75678a5c612e is going to be updated. [ 1294.645202] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.645202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.645202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.645202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.645202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.654868] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20d9f07b-22ae-49bd-b703-75678a5c612e in Status: IN_PROGRESS for 2s [ 1294.920006] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.920184] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.920260] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.920480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.920573] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.920676] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1294.956297] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.956528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.956528] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.956703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.956840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.965130] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1296.664520] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20d9f07b-22ae-49bd-b703-75678a5c612e in Status: SUCCESS [ 1296.664843] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20d9f07b-22ae-49bd-b703-75678a5c612e deletion is rescheduled due to dependency. [ 1296.664843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20d9f07b-22ae-49bd-b703-75678a5c612e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.974917] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1296.975203] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.975369] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.975594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.975950] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.976109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.976179] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.976339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.976421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.976505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.976596] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.478400] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.478632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.478632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.478896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.479111] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.479228] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.479359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.479590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.479735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.479875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.480072] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.480198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.480256] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.480439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.480604] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.480728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.480794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.481039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.481151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.481262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.481380] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.986874] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a80d85d-9154-4a27-bab2-481460122696: rpc.has_security_group_logging(os_id): False [ 1298.003912] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.003996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.004087] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.004341] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.004435] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.004642] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.004745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.004811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.004959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.005047] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.005234] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.005327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.005387] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.005527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.005602] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.005788] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.005883] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.005926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.006080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.006153] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.006238] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1298.062493] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.062746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.062746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.062941] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.063063] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.079231] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1299.112410] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.112855] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1300.096791] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1300.097046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.910106] env[69777]: INFO networking_nsxv3.common.synchronization [req-8b1a9b57-b6f8-419d-905a-d02cdba7e9a2 req-9e85dea0-b204-4176-b483-b28c638ed1c0 tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1301.910413] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1301.910726] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.910905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.910905] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.911371] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.911486] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.911549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.911586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.911878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.911878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.911997] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.414686] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.414974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.414974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.415249] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.415382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.415650] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.415768] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.415855] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.416095] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.416238] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.416299] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be updated. [ 1302.443655] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.443916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.444020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.444691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.444691] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.453660] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: IN_PROGRESS for 2s [ 1304.474577] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 1304.474996] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e deletion is rescheduled due to dependency. [ 1304.474996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.911481] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1306.911769] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1308.941257] env[69777]: INFO networking_nsxv3.common.synchronization [req-3b30fa7a-3d67-4def-b090-2e1e9df47a15 req-ca5f7eca-c06f-4c7b-92cf-8747c17f29e2 tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1308.941506] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1308.941788] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.941930] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.941998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.942209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.942359] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.942458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.942552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.942661] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.942745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.942849] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.224497] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.224786] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.225075] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.225250] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.226374] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.226374] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.226374] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.226374] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.226609] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.226818] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1309.226994] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1309.227165] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1309.227319] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1309.227472] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1309.227620] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1309.228351] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1309.247562] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1309.247793] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1309.247976] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1309.248211] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-740" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.248580] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-2bc873d9-1ddc-4393-85ff-6c663facc523 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.248797] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-2bc873d9-1ddc-4393-85ff-6c663facc523" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.248979] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-2bc873d9-1ddc-4393-85ff-6c663facc523" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.249299] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-2bc873d9-1ddc-4393-85ff-6c663facc523" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.249581] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bc873d9-1ddc-4393-85ff-6c663facc523',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.445642] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.445880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.445960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.446191] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.446300] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.446483] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.446580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.446645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.446805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.446888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.446969] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be updated. [ 1309.473439] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.473626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.473626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.473827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.473964] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.482188] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: IN_PROGRESS for 2s [ 1309.529539] env[69777]: INFO networking_nsxv3.common.synchronization [req-a49ce3c1-e0b6-4aac-b986-0f045446a0c6 req-05e97757-5f42-456d-bb48-31bebcc01bf6 tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1309.530087] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1309.530371] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.530487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.530553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.530748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.530891] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.530985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.531055] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.531208] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.531285] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.531369] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.752525] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.752904] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.753153] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.753467] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.754293] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.754293] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 2bc873d9-1ddc-4393-85ff-6c663facc523 not found, creating... [ 1309.754293] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.754293] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.754473] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.754589] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.754733] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.756546] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.756686] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.756816] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.757149] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.757331] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.757487] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 2bc873d9-1ddc-4393-85ff-6c663facc523 is going to be created. [ 1309.782589] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.782864] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.782971] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.783292] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.783534] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.783795] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-2bc873d9-1ddc-4393-85ff-6c663facc523" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.033426] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.463019] env[69777]: INFO networking_nsxv3.common.synchronization [req-3b30fa7a-3d67-4def-b090-2e1e9df47a15 req-4e7eacd1-ad8e-4291-a018-b2fa7a4eae56 service nova] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_rules [ 1310.463019] env[69777]: INFO networking_nsxv3.common.synchronization [req-3b30fa7a-3d67-4def-b090-2e1e9df47a15 req-4e7eacd1-ad8e-4291-a018-b2fa7a4eae56 service nova] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1310.463019] env[69777]: INFO networking_nsxv3.common.synchronization [req-3b30fa7a-3d67-4def-b090-2e1e9df47a15 req-4e7eacd1-ad8e-4291-a018-b2fa7a4eae56 service nova] Enqueued Resource ID: 2bc873d9-1ddc-4393-85ff-6c663facc523 with Priority: HIGHEST for action port [ 1310.463019] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_rules [ 1310.463019] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1310.463019] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc873d9-1ddc-4393-85ff-6c663facc523 with Priority: HIGHEST for action port [ 1310.463019] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.463019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.463019] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.464089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.464377] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.467099] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.468084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.468084] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bc873d9-1ddc-4393-85ff-6c663facc523 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.468084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bc873d9-1ddc-4393-85ff-6c663facc523" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.468084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bc873d9-1ddc-4393-85ff-6c663facc523" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.468084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bc873d9-1ddc-4393-85ff-6c663facc523" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.468084] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bc873d9-1ddc-4393-85ff-6c663facc523',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.536176] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.970331] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.970479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.970634] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bc873d9-1ddc-4393-85ff-6c663facc523 with status ACTIVE [ 1310.970803] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.970909] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.970977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.971219] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.971303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.971471] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.971565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.971626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.971769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.971901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.972123] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.972220] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.972282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.972424] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.972531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.972603] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bc873d9-1ddc-4393-85ff-6c663facc523 is going to be updated. [ 1310.991501] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.991670] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.991715] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.991892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.992018] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.992172] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bc873d9-1ddc-4393-85ff-6c663facc523" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.037785] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.038173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.038173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.038173] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.038319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.038359] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 is going to be updated. [ 1311.086688] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.086820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.086878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.087089] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.087231] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.096294] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: IN_PROGRESS for 2s [ 1311.491974] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 1311.492278] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e deletion is rescheduled due to dependency. [ 1311.492386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.492453] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.492936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.493192] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.493295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.493353] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.493485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.493562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.493656] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.996192] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.498475] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.003455] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.003455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.003455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.003455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.003455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.003455] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be updated. [ 1313.029259] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.029259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.029259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.029259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.029525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.038110] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: IN_PROGRESS for 2s [ 1313.106235] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: SUCCESS [ 1313.106358] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.930292] env[69777]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1313.930548] env[69777]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b0c46c0a-1479-4426-85d6-3f6ad8bde52f None None] NSXv3 Agent Agent loop - iteration:3 started [ 1315.048419] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 1315.048778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.048837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.049022] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.049213] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.049350] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.049451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.049612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.049713] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.049805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.049921] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.462820] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.463073] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1315.551739] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.053786] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d94c1310-5466-4ce7-9d83-c7c474aa637e: rpc.has_security_group_logging(os_id): False [ 1316.071771] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.071979] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.072054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.072295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.072392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.072638] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.072740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.072807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.072961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.073054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.073142] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be updated. [ 1316.124123] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.124272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.124272] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.124472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.124605] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.135835] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: IN_PROGRESS for 2s [ 1316.934316] env[69777]: INFO networking_nsxv3.common.synchronization [req-2363952d-19f2-4f24-bc81-e9a00fb7eb77 req-df89cfcf-23d2-4d9b-b50f-90830c006aea tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1316.934428] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGHEST for action security_group_members [ 1316.934733] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.934852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.934921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.935301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.935469] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.935574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.935640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.935810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.935871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.935966] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.438803] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.439103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.439103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.439338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.439449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.439656] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.439773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.439853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.440146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.440146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.440263] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 is going to be updated. [ 1317.465691] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.465859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.465911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.466118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.466533] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.476343] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: IN_PROGRESS for 2s [ 1318.148611] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 1318.148859] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.487734] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 321cefa0-5927-4827-bb54-946d4d4296b8 in Status: SUCCESS [ 1319.488020] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 deletion is rescheduled due to dependency. [ 1319.488094] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.854835] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-138 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.855182] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.855182] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.855455] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.855752] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.855917] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.856048] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.856269] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.856417] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.856631] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1320.856747] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1320.856859] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1320.856996] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1320.857164] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1320.857282] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1320.857416] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1320.876071] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1320.876071] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1320.876071] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1320.876450] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-138" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.876526] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-9c75e83a-76df-4b02-a52b-58dd3aa6441e taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.876702] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.876826] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.877100] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.877305] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c75e83a-76df-4b02-a52b-58dd3aa6441e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.139275] env[69777]: INFO networking_nsxv3.common.synchronization [req-6efb0436-e0b6-4532-ad5c-c075cad780d5 req-26b9477e-9450-4a2f-b979-f9fcae5903ba tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_members [ 1321.140551] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGHEST for action security_group_members [ 1321.141610] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a99be3-2c8a-42ba-8c6c-44364c3737d8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.141803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.141803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.141991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.142172] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.142314] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.142466] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.142563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.142648] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.142732] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.379795] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.380288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.380288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.380288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.380489] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.380705] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.380873] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.380998] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.381261] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.381399] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.381684] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.381843] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.382014] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.385766] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.385919] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.386178] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 9c75e83a-76df-4b02-a52b-58dd3aa6441e is going to be updated. [ 1321.405800] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.406028] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.406201] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.406469] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.406665] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.406896] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.645514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.645721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.645721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.645954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.646070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.646214] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.646307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.646376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.646518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.646914] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.647072] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 is going to be updated. [ 1321.672376] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.672572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.672572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.672706] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.672834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.680019] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 in Status: IN_PROGRESS for 2s [ 1322.080838] env[69777]: INFO networking_nsxv3.common.synchronization [req-6c7fbcdc-0eb2-44ce-a855-ee1996b730bd req-9dbb73b1-fce3-4e21-8feb-9d2b69f7fbc4 service nova] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 1322.081125] env[69777]: INFO networking_nsxv3.common.synchronization [req-6c7fbcdc-0eb2-44ce-a855-ee1996b730bd req-9dbb73b1-fce3-4e21-8feb-9d2b69f7fbc4 service nova] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1322.081220] env[69777]: INFO networking_nsxv3.common.synchronization [req-6c7fbcdc-0eb2-44ce-a855-ee1996b730bd req-9dbb73b1-fce3-4e21-8feb-9d2b69f7fbc4 service nova] Enqueued Resource ID: 9c75e83a-76df-4b02-a52b-58dd3aa6441e with Priority: HIGHEST for action port [ 1322.081397] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_rules [ 1322.081528] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1322.081624] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c75e83a-76df-4b02-a52b-58dd3aa6441e with Priority: HIGHEST for action port [ 1322.082513] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.082645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.082716] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.082911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.083053] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.085571] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.085571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.085571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.085571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.085571] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.085571] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.085806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.085806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.085871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.085909] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.086650] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c75e83a-76df-4b02-a52b-58dd3aa6441e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.086753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.086991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.086991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.087088] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c75e83a-76df-4b02-a52b-58dd3aa6441e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.589111] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.590160] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.590291] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.590428] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c75e83a-76df-4b02-a52b-58dd3aa6441e with status ACTIVE [ 1322.590581] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.590685] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.590765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.590951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.591054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.591225] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.591322] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.591386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.591534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.591610] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.591783] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.591873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.591933] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.592109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.592385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.592385] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c75e83a-76df-4b02-a52b-58dd3aa6441e is going to be updated. [ 1322.619682] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.619836] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.619884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.620116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.620248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.620402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c75e83a-76df-4b02-a52b-58dd3aa6441e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.962370] env[69777]: INFO networking_nsxv3.common.synchronization [None req-e6369cf8-dfe8-47ea-9d3f-7049cd91007d tempest-AttachInterfacesTestJSON-186804226 tempest-AttachInterfacesTestJSON-186804226-project-member] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1322.962370] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGHEST for action security_group_members [ 1322.962370] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.962370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.962370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.962611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.962611] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.962611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.962902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.962902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.962902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.963031] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.094137] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.466536] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.466714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.466768] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.466984] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.467093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.467294] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.467393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.467452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.467609] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.467688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.467775] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be updated. [ 1323.494623] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.494856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.494971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.495296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.495549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.504914] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: IN_PROGRESS for 2s [ 1323.597120] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.597351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.597351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.597558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.597640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.597740] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 1323.624212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.624445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.624493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.624739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.624850] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.632391] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1323.689786] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 in Status: SUCCESS [ 1323.689997] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 deletion is rescheduled due to dependency. [ 1323.691897] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.513673] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a80d85d-9154-4a27-bab2-481460122696 in Status: SUCCESS [ 1325.514061] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a80d85d-9154-4a27-bab2-481460122696 deletion is rescheduled due to dependency. [ 1325.514061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.643295] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1325.643557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.643727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.643966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.644201] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.646841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.646986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.647122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.647227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.647324] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.647432] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.907967] env[69777]: INFO networking_nsxv3.common.synchronization [None req-2505ab04-759d-4d98-a899-44c26b2f6a00 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_rules [ 1325.908763] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_rules [ 1325.909592] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.910309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.910309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.910309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.910557] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.983367] env[69777]: INFO networking_nsxv3.common.synchronization [None req-11610b22-66a1-4b9a-b642-cae29bc49760 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_rules [ 1325.984119] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_rules [ 1325.984488] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.984638] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.149638] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.438885] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.439082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.439161] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.439392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.439629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.439784] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 already deleted. [ 1326.439927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.440138] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.440345] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.440473] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.652594] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd51d8a4-0c41-4e95-a3e3-1f0da556ee84: rpc.has_security_group_logging(os_id): False [ 1326.672021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.672021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.672021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.672021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.672021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.672021] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.672021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.672021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.672021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.672021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.672021] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 1326.691952] env[69777]: INFO networking_nsxv3.common.synchronization [req-8abe129b-17be-4f59-ac52-9d0dde43bb69 req-5b9cd202-58b8-42e7-b538-bdf8f4add371 tempest-AttachVolumeShelveTestJSON-523183173 tempest-AttachVolumeShelveTestJSON-523183173-project-member] Enqueued Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_members [ 1326.692820] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 with Priority: HIGHEST for action security_group_members [ 1326.693150] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.693878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.693878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.693878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.693878] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.694280] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.694280] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.694280] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.694383] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.694428] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f4ac00d-66c7-42bf-aa2f-53b5984883e3',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.728703] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.728853] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.728952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.729574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.729574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.743896] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1326.959965] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.960258] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.960335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.960651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.960912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.961099] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 already deleted. [ 1326.961211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.197422] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.197581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.197657] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.197874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.197968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.198175] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.198273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.198329] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.198574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.198656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.198745] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 is going to be updated. [ 1327.225486] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.225629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.225705] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.225919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.226082] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.234210] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 in Status: IN_PROGRESS for 2s [ 1328.761756] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1328.762209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.246545] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 in Status: SUCCESS [ 1329.246545] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4ac00d-66c7-42bf-aa2f-53b5984883e3 deletion is rescheduled due to dependency. [ 1329.246658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4ac00d-66c7-42bf-aa2f-53b5984883e3" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.693305] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1331.693718] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.980486] env[69777]: INFO networking_nsxv3.common.synchronization [req-ce078e05-b59e-40ed-a6f1-98f71586c402 req-f097b77c-bf6f-4ac0-82a2-b1082549c9c6 tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_members [ 1332.980486] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_members [ 1332.980921] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.980921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.981030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.982080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.982080] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.982080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.982080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.982080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.982080] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.982518] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.259673] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.259919] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.260097] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.260467] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.260774] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.260965] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.261122] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.261378] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.261542] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.261779] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1333.261910] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1333.262093] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1333.262212] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1333.262348] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1333.262470] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1333.262630] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1333.284886] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1333.285049] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1333.285232] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1333.285428] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-893" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.285737] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-638732d7-cc58-4abd-b079-30557c8d2238 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.285903] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-638732d7-cc58-4abd-b079-30557c8d2238" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.286040] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-638732d7-cc58-4abd-b079-30557c8d2238" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.286361] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-638732d7-cc58-4abd-b079-30557c8d2238" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.286503] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('638732d7-cc58-4abd-b079-30557c8d2238',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.484413] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.484592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.484669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.484890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.484982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.485197] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.485303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.485365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.485513] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.485590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.485675] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 already deleted. [ 1333.485754] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.789120] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.789120] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.789120] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.789498] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.789498] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.789598] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 638732d7-cc58-4abd-b079-30557c8d2238 not found, creating... [ 1333.789799] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.790089] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.790089] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.790591] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.790591] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.790798] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.790881] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.790970] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.791215] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.791355] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.791496] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 638732d7-cc58-4abd-b079-30557c8d2238 is going to be created. [ 1333.811260] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.811443] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.811571] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.811798] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.812080] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.812285] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-638732d7-cc58-4abd-b079-30557c8d2238" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.470305] env[69777]: INFO networking_nsxv3.common.synchronization [req-ce078e05-b59e-40ed-a6f1-98f71586c402 req-46d3fe8c-11b2-416e-8fc1-a6b84427ffcc service nova] Enqueued Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_rules [ 1334.470579] env[69777]: INFO networking_nsxv3.common.synchronization [req-ce078e05-b59e-40ed-a6f1-98f71586c402 req-46d3fe8c-11b2-416e-8fc1-a6b84427ffcc service nova] Enqueued Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_members [ 1334.470619] env[69777]: INFO networking_nsxv3.common.synchronization [req-ce078e05-b59e-40ed-a6f1-98f71586c402 req-46d3fe8c-11b2-416e-8fc1-a6b84427ffcc service nova] Enqueued Resource ID: 638732d7-cc58-4abd-b079-30557c8d2238 with Priority: HIGHEST for action port [ 1334.470841] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_rules [ 1334.470968] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_members [ 1334.471077] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638732d7-cc58-4abd-b079-30557c8d2238 with Priority: HIGHEST for action port [ 1334.471621] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.471778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.471812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.472009] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.472122] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.472987] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.473101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.473174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.473336] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.473484] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.473577] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.473639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.473775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.473856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.473988] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.474947] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-638732d7-cc58-4abd-b079-30557c8d2238 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.475097] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-638732d7-cc58-4abd-b079-30557c8d2238" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.475163] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-638732d7-cc58-4abd-b079-30557c8d2238" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.475330] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-638732d7-cc58-4abd-b079-30557c8d2238" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.478048] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('638732d7-cc58-4abd-b079-30557c8d2238',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.977169] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.977379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.977622] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.981183] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 638732d7-cc58-4abd-b079-30557c8d2238 with status ACTIVE [ 1334.981389] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.981499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.981563] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.981759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.981843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.982017] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.982868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.982868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.982868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.982868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.982868] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.982868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.982868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.982868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.983283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.983283] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 638732d7-cc58-4abd-b079-30557c8d2238 is going to be updated. [ 1335.001986] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.002131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.002196] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.002352] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.002477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.002622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-638732d7-cc58-4abd-b079-30557c8d2238" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.479451] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.982481] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.982481] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.982733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.982773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.982873] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.983078] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 is going to be created. [ 1336.007876] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.008048] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.008198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.008423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.008614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.017361] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 in Status: UNINITIALIZED for 2s [ 1337.932299] env[69777]: INFO networking_nsxv3.common.synchronization [req-d663556d-eeaf-4daa-b24e-9fa8a1d58df2 req-7e270220-58bb-4e92-aa21-efd34736e7a7 tempest-ServerActionsTestOtherB-1106354566 tempest-ServerActionsTestOtherB-1106354566-project-member] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1337.932790] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGHEST for action security_group_members [ 1337.933115] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.933250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.933320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.933517] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.933731] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.933882] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.933959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.934111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.934198] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.934293] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.033035] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 in Status: SUCCESS [ 1338.033035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.033035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.033035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.033035] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.033035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.033035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.033035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.033035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.033035] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.033035] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.436672] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.436967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.436967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.437139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.437286] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.437499] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.437599] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.437688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.437862] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.437958] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.438097] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be updated. [ 1338.465430] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.465633] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.465774] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.465967] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.466165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.474546] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: IN_PROGRESS for 2s [ 1338.534471] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.036796] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8: rpc.has_security_group_logging(os_id): False [ 1339.053160] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.053304] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.053385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.053569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.053654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.053887] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.053982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.054057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.054202] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.054478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.054478] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 is going to be created. [ 1339.110715] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.110884] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.110927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.111125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.111301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.120991] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 in Status: IN_PROGRESS for 2s [ 1340.483724] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 in Status: SUCCESS [ 1340.484069] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 deletion is rescheduled due to dependency. [ 1340.484069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.133161] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 in Status: SUCCESS [ 1341.133458] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.935418] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.935704] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1347.937254] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.937254] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.950831] env[69777]: INFO networking_nsxv3.common.synchronization [None req-077b40f5-0fb0-4505-8b0d-d73f8187ac18 None None] Enqueued Resource ID: badae205-b8e8-4346-b699-dd75c0f81f11 with Priority: HIGHEST for action port [ 1348.951436] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: badae205-b8e8-4346-b699-dd75c0f81f11 with Priority: HIGHEST for action port [ 1348.951769] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-badae205-b8e8-4346-b699-dd75c0f81f11 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.951899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-badae205-b8e8-4346-b699-dd75c0f81f11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.951968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-badae205-b8e8-4346-b699-dd75c0f81f11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.952262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-badae205-b8e8-4346-b699-dd75c0f81f11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.952350] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('badae205-b8e8-4346-b699-dd75c0f81f11',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.455498] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port badae205-b8e8-4346-b699-dd75c0f81f11 [ 1349.455817] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.456044] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.456130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.456413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.456545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.456674] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:badae205-b8e8-4346-b699-dd75c0f81f11 already deleted. [ 1349.456786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-badae205-b8e8-4346-b699-dd75c0f81f11" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.123066] env[69777]: INFO networking_nsxv3.common.synchronization [None req-339309b4-e274-4762-b4ba-80000377bb37 None None] Enqueued Resource ID: 78d07aef-479d-4f94-9762-6dd584390cc1 with Priority: HIGHEST for action port [ 1351.123361] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78d07aef-479d-4f94-9762-6dd584390cc1 with Priority: HIGHEST for action port [ 1351.123910] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-78d07aef-479d-4f94-9762-6dd584390cc1 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.124059] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78d07aef-479d-4f94-9762-6dd584390cc1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.124135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78d07aef-479d-4f94-9762-6dd584390cc1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.124388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78d07aef-479d-4f94-9762-6dd584390cc1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.124473] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78d07aef-479d-4f94-9762-6dd584390cc1',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.626789] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78d07aef-479d-4f94-9762-6dd584390cc1 [ 1351.627037] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.627170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.627241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.627446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.627554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.627649] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78d07aef-479d-4f94-9762-6dd584390cc1 already deleted. [ 1351.627730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78d07aef-479d-4f94-9762-6dd584390cc1" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.810916] env[69777]: INFO networking_nsxv3.common.synchronization [req-358d4ee3-cab5-406c-9947-e43b849a342f req-e137fdb7-4618-4f57-af42-badf5c3e5ca4 tempest-ServerAddressesNegativeTestJSON-4714381 tempest-ServerAddressesNegativeTestJSON-4714381-project-member] Enqueued Resource ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c with Priority: HIGHEST for action security_group_members [ 1353.811567] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c with Priority: HIGHEST for action security_group_members [ 1353.811879] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fcdf94-41b1-46a2-ad09-83aa96da571c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.812010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.812084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.812358] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.812505] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.812603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.812666] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.812854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.812890] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.812974] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34fcdf94-41b1-46a2-ad09-83aa96da571c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.059580] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-888 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.059580] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-888" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.059580] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-888" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.059927] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-888" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.060206] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.060377] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.060500] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.060788] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.060948] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.061320] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1354.061449] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1354.061569] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1354.061682] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1354.061797] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1354.061907] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1354.062056] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1354.079905] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1354.080081] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1354.080227] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1354.080419] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-888" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.080674] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-b5248ec3-e461-4702-ba77-d3dcdefa4173 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.080836] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-b5248ec3-e461-4702-ba77-d3dcdefa4173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.080960] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-b5248ec3-e461-4702-ba77-d3dcdefa4173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.082527] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-b5248ec3-e461-4702-ba77-d3dcdefa4173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.082527] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5248ec3-e461-4702-ba77-d3dcdefa4173',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.316103] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.316103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.316103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.316103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.316103] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.316103] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.316477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.316477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.316477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.316477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.316587] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c already deleted. [ 1354.316660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.585402] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.585696] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.585868] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.586199] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.586411] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.586591] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port b5248ec3-e461-4702-ba77-d3dcdefa4173 not found, creating... [ 1354.586859] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.587033] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.587161] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.587387] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.587530] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.587820] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.587982] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.588117] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.588803] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.588803] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.588803] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: b5248ec3-e461-4702-ba77-d3dcdefa4173 is going to be created. [ 1354.608284] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.608441] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.608580] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.608869] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.609090] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.609339] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-b5248ec3-e461-4702-ba77-d3dcdefa4173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.301102] env[69777]: INFO networking_nsxv3.common.synchronization [req-358d4ee3-cab5-406c-9947-e43b849a342f req-a47d8705-f5e2-44e9-996c-b641605cd27f service nova] Enqueued Resource ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c with Priority: HIGHEST for action security_group_rules [ 1355.302459] env[69777]: INFO networking_nsxv3.common.synchronization [req-358d4ee3-cab5-406c-9947-e43b849a342f req-a47d8705-f5e2-44e9-996c-b641605cd27f service nova] Enqueued Resource ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c with Priority: HIGHEST for action security_group_members [ 1355.302459] env[69777]: INFO networking_nsxv3.common.synchronization [req-358d4ee3-cab5-406c-9947-e43b849a342f req-a47d8705-f5e2-44e9-996c-b641605cd27f service nova] Enqueued Resource ID: b5248ec3-e461-4702-ba77-d3dcdefa4173 with Priority: HIGHEST for action port [ 1355.302459] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c with Priority: HIGHEST for action security_group_rules [ 1355.302459] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c with Priority: HIGHEST for action security_group_members [ 1355.302459] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5248ec3-e461-4702-ba77-d3dcdefa4173 with Priority: HIGHEST for action port [ 1355.302749] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34fcdf94-41b1-46a2-ad09-83aa96da571c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.302880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.302950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.303382] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.303503] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34fcdf94-41b1-46a2-ad09-83aa96da571c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.304430] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fcdf94-41b1-46a2-ad09-83aa96da571c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.304663] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.304730] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.304932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.305129] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.305274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.305359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.305527] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.305634] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.305747] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34fcdf94-41b1-46a2-ad09-83aa96da571c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.309265] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5248ec3-e461-4702-ba77-d3dcdefa4173 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.309421] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5248ec3-e461-4702-ba77-d3dcdefa4173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.309567] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5248ec3-e461-4702-ba77-d3dcdefa4173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.309753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5248ec3-e461-4702-ba77-d3dcdefa4173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.309836] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5248ec3-e461-4702-ba77-d3dcdefa4173',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.812240] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fcdf94-41b1-46a2-ad09-83aa96da571c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.812445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.812590] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34fcdf94-41b1-46a2-ad09-83aa96da571c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.815069] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5248ec3-e461-4702-ba77-d3dcdefa4173 with status ACTIVE [ 1355.815275] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.815486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.815767] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.815861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.815961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.816166] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.816273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.816338] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.816504] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.816596] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.816767] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.816861] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.816919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.817065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.817151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.817284] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5248ec3-e461-4702-ba77-d3dcdefa4173 is going to be updated. [ 1355.836339] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.836628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.836628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.836896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.837109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.837328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5248ec3-e461-4702-ba77-d3dcdefa4173" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.315184] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34fcdf94-41b1-46a2-ad09-83aa96da571c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.817495] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.817652] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.817721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.817939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.818040] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.818140] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c is going to be created. [ 1356.840861] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.841083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.841083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.841294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.841454] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.849392] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c in Status: UNINITIALIZED for 2s [ 1358.860101] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c in Status: SUCCESS [ 1358.860101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.860495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.860495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.860666] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.860780] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.860847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.861011] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.861097] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.861180] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.861268] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34fcdf94-41b1-46a2-ad09-83aa96da571c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.363631] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fcdf94-41b1-46a2-ad09-83aa96da571c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.363936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.363936] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.365149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.365149] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.365149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.365149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.365149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.365149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.365149] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.365982] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fcdf94-41b1-46a2-ad09-83aa96da571c taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.365982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.365982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.365982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.365982] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.365982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.366246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.366246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.366311] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.366408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.366527] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34fcdf94-41b1-46a2-ad09-83aa96da571c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.869390] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34fcdf94-41b1-46a2-ad09-83aa96da571c: rpc.has_security_group_logging(os_id): False [ 1359.886939] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.887072] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.887145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.887328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.887422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.887665] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.887773] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.887829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.887981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.888073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.888259] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.888351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.888404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.888541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.888613] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.888785] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.888878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.888940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.889126] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.889206] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.889290] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c is going to be created. [ 1359.939969] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.940107] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.940181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.940397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.940569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.949419] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c in Status: IN_PROGRESS for 2s [ 1360.303478] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.303646] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1361.961901] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c in Status: SUCCESS [ 1361.962351] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.868402] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.868919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.868919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.868919] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.868919] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.304613] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.304769] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1365.371325] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.873718] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.922788] env[69777]: INFO networking_nsxv3.common.synchronization [req-89cf7cee-7de8-479b-b805-fd8230a1b6af req-9cd308ac-a4b1-45ed-ad1b-068d73dc0670 tempest-ServerAddressesNegativeTestJSON-4714381 tempest-ServerAddressesNegativeTestJSON-4714381-project-member] Enqueued Resource ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c with Priority: HIGHEST for action security_group_members [ 1365.922947] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c with Priority: HIGHEST for action security_group_members [ 1365.923570] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fcdf94-41b1-46a2-ad09-83aa96da571c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.923570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.923570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.924282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.924282] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.924282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.924282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.924282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.924282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.924282] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34fcdf94-41b1-46a2-ad09-83aa96da571c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.376513] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1366.376675] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1366.426436] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.426589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.426660] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.426880] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.427139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.427173] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.427267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.427323] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.427477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.427566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.427655] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c is going to be updated. [ 1366.458776] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.458907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.458988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.459182] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.459325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.468614] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c in Status: IN_PROGRESS for 2s [ 1367.146410] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.146700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.146700] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.146821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.158129] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1367.158966] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.160049] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1367.193845] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.193997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.194062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.194248] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.206340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.206981] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1367.207070] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1367.207162] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1367.240057] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.240189] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.240246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.240455] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.241789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.241920] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1367.313751] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.313984] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.313984] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.314174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.314477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.314736] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1367.386155] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.386344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.386344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.386552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.386834] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.387110] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1367.387206] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'4cb60d30-acd9-42ec-9942-d71d6c7c14f6', '6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8', '34fcdf94-41b1-46a2-ad09-83aa96da571c', 'f64a4b87-9b99-4306-97e4-e97d2b7d7388', 'dd51d8a4-0c41-4e95-a3e3-1f0da556ee84', 'c7b1a811-2cde-4056-af4d-31f7ea781dba', 'd11a036c-e695-48d0-bc8a-32f7a8cd8485', '07670245-7199-41ee-bb6c-b1ff49af92c4', '321cefa0-5927-4827-bb54-946d4d4296b8', '3a80d85d-9154-4a27-bab2-481460122696', 'ad2cbd17-afe0-45e7-973d-4380ccd03877', '81a99be3-2c8a-42ba-8c6c-44364c3737d8', 'd2102ed9-efb2-4a2c-a170-b1e7872f4215', '472e5966-9eb6-4e5f-91b6-9f0b0df9c87e', 'a246dbb9-bbe3-4f92-8823-3c958f77d63e', '2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0', '50bad828-a4cc-463b-9c54-306ad5358f8d', '54f2e457-46a8-40bd-9513-a556b213a51c', '558602f0-d46e-4c1e-9820-0cf4971db17b', 'ec67cf45-130c-446e-bc7a-8c1eb32450c7', '96e24b09-4a12-4902-8139-2df8e6a535e0', '06bee688-2b64-4a9b-b0eb-ee4c735a9c41', 'f44fd483-f70f-4a69-967b-e48536b42565', '5ee1d406-4eef-4a6f-9340-fafaa839ac55', '9f4ac00d-66c7-42bf-aa2f-53b5984883e3', 'bf7f4ddc-ed21-4d94-8cea-71e39c933549', '934508a6-471e-40c3-b26e-4595587a983c', '6831ceb6-9d33-4058-9454-2d8e13eb4e86', 'dfaae587-8793-4f50-bc13-dd477aa227cd', '54ece09a-8f35-4152-a654-20e3b05650f5', '20d9f07b-22ae-49bd-b703-75678a5c612e', '15fc107d-52a0-4aa7-83cd-a96824b186f6', 'dfc00e54-a878-499a-acb4-f2b1c4844df7', 'd94c1310-5466-4ce7-9d83-c7c474aa637e', '34d3f208-bbb4-4415-9934-a2683e967524', 'c31a3d66-3f9b-4509-bdc2-763f23333743', 'c0519206-80b2-42a4-bf40-fb2cb2292017', 'aa84311d-f462-487f-91c4-49b7e8315838', 'cf27a656-ea7d-4a2d-b6f9-fe71cbf46653', '9c1512ec-3cb3-4a3e-9626-035d7eea4067', '47227221-8e24-429f-b3e4-917bd42f6a48'} {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1367.387288] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1367.402932] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.403074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.403143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.403262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.403358] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.403459] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1367.403534] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1367.403636] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1367.480389] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.480566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.480671] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.480839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.481932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.482194] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1367.482273] env[69777]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69777) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1367.482383] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1367.482443] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1367.482512] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1367.482584] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGH for action security_group_rules [ 1367.482661] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGH for action security_group_rules [ 1367.482728] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c with Priority: HIGH for action security_group_rules [ 1367.482808] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGH for action security_group_rules [ 1367.482917] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGH for action security_group_rules [ 1367.482974] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGH for action security_group_rules [ 1367.483042] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGH for action security_group_rules [ 1367.483042] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGH for action security_group_rules [ 1367.483118] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGH for action security_group_rules [ 1367.483183] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGH for action security_group_rules [ 1367.483287] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGH for action security_group_rules [ 1367.483334] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGH for action security_group_rules [ 1367.483397] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGH for action security_group_rules [ 1367.483461] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGH for action security_group_rules [ 1367.483525] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGH for action security_group_rules [ 1367.483583] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 with Priority: HIGH for action security_group_rules [ 1367.483644] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGH for action security_group_rules [ 1367.483701] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGH for action security_group_rules [ 1367.483765] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 558602f0-d46e-4c1e-9820-0cf4971db17b with Priority: HIGH for action security_group_rules [ 1367.483826] env[69777]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGH for action security_group_rules [ 1367.483921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.476251] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c in Status: SUCCESS [ 1368.476505] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c deletion is rescheduled due to dependency. [ 1368.476541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.923862] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.924232] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1370.924232] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 with Priority: HIGH for action security_group_rules [ 1370.924232] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c with Priority: HIGH for action security_group_rules [ 1370.924394] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGH for action security_group_rules [ 1370.924394] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e with Priority: HIGH for action security_group_rules [ 1370.924483] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 with Priority: HIGH for action security_group_rules [ 1370.924578] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 558602f0-d46e-4c1e-9820-0cf4971db17b with Priority: HIGH for action security_group_rules [ 1370.924670] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f2e457-46a8-40bd-9513-a556b213a51c with Priority: HIGH for action security_group_rules [ 1370.924758] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bad828-a4cc-463b-9c54-306ad5358f8d with Priority: HIGH for action security_group_rules [ 1370.924846] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e with Priority: HIGH for action security_group_rules [ 1370.924931] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 with Priority: HIGH for action security_group_rules [ 1370.925025] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 with Priority: HIGH for action security_group_rules [ 1370.925113] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 with Priority: HIGH for action security_group_rules [ 1370.925198] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 with Priority: HIGH for action security_group_rules [ 1370.925285] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a80d85d-9154-4a27-bab2-481460122696 with Priority: HIGH for action security_group_rules [ 1370.925370] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cefa0-5927-4827-bb54-946d4d4296b8 with Priority: HIGH for action security_group_rules [ 1370.925457] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b1a811-2cde-4056-af4d-31f7ea781dba with Priority: HIGH for action security_group_rules [ 1370.925543] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 with Priority: HIGH for action security_group_rules [ 1370.925627] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 with Priority: HIGH for action security_group_rules [ 1370.925711] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGH for action security_group_rules [ 1370.925799] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 with Priority: HIGH for action security_group_rules [ 1370.926157] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.926289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.926461] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.926649] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.926735] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb60d30-acd9-42ec-9942-d71d6c7c14f6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.930904] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34fcdf94-41b1-46a2-ad09-83aa96da571c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.930904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.930904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.930904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.930904] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34fcdf94-41b1-46a2-ad09-83aa96da571c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.930904] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.930904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.930904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.930904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.930904] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.930904] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.930904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.930904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.930904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.930904] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a246dbb9-bbe3-4f92-8823-3c958f77d63e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.931583] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.931583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.931583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.931583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.931583] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec67cf45-130c-446e-bc7a-8c1eb32450c7',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.932271] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-558602f0-d46e-4c1e-9820-0cf4971db17b taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.932271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.932467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.932497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.932604] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('558602f0-d46e-4c1e-9820-0cf4971db17b',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.933241] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54f2e457-46a8-40bd-9513-a556b213a51c taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.933340] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.933394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.933503] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.933564] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54f2e457-46a8-40bd-9513-a556b213a51c',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.934241] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50bad828-a4cc-463b-9c54-306ad5358f8d taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.934763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.934763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.934763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.934763] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50bad828-a4cc-463b-9c54-306ad5358f8d',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.935283] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.935408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.935467] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.935688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.935688] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('472e5966-9eb6-4e5f-91b6-9f0b0df9c87e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.936434] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.936603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.936603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.936752] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.936834] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.937647] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.937765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.937803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.937997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.938091] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2102ed9-efb2-4a2c-a170-b1e7872f4215',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.938701] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.938827] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.938892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.938999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.939076] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81a99be3-2c8a-42ba-8c6c-44364c3737d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.939745] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad2cbd17-afe0-45e7-973d-4380ccd03877 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.939868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.939926] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.940092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.940159] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad2cbd17-afe0-45e7-973d-4380ccd03877',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.940880] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a80d85d-9154-4a27-bab2-481460122696 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.941060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.941122] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.941275] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.941349] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a80d85d-9154-4a27-bab2-481460122696',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.942025] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-321cefa0-5927-4827-bb54-946d4d4296b8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.942189] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.942189] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.942782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.942782] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('321cefa0-5927-4827-bb54-946d4d4296b8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.943169] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7b1a811-2cde-4056-af4d-31f7ea781dba taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.943250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.943250] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.943404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.943475] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7b1a811-2cde-4056-af4d-31f7ea781dba',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.944389] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07670245-7199-41ee-bb6c-b1ff49af92c4 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.944389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.944389] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.944574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.944574] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07670245-7199-41ee-bb6c-b1ff49af92c4',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.945358] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.945358] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.945556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.945556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.945659] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd51d8a4-0c41-4e95-a3e3-1f0da556ee84',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.946254] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.946376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.946434] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.946552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.946619] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.947284] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.947409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.947472] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.947623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.947692] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f64a4b87-9b99-4306-97e4-e97d2b7d7388',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.969335] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.969470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.969470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.969618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.991275] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.991401] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0 is going to be deleted. [ 1371.037284] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.037418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.037494] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.037694] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.037784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.037899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f7a83d7-68d4-406f-b2a3-efd8c6ce3ee0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.456564] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.456719] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.456789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.456998] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.457175] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.457275] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.457339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.457486] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.457569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.457654] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.457738] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.466130] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11a036c-e695-48d0-bc8a-32f7a8cd8485 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.466326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.466326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.466545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.466699] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.466798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.466864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.467016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.467109] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.467252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.467297] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.498082] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.498232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.498302] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.498501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.500026] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.500128] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.510011] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.510177] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.511054] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.511150] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.511854] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.511950] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.518097] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.518204] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.519041] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.519319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.522283] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.522549] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.523330] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.523432] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.524211] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.524310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.525073] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.525174] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.525800] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1371.526200] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.526292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.526857] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1371.527516] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.527516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.527952] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1371.528614] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.528614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.529052] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1371.529735] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.529735] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.530068] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1371.530449] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.530551] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.531406] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1371.531785] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.532106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.532430] env[69777]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1371.532794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.533132] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a246dbb9-bbe3-4f92-8823-3c958f77d63e is going to be deleted. [ 1371.533932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.533932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.558703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.558703] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50bad828-a4cc-463b-9c54-306ad5358f8d is going to be deleted. [ 1371.559293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.559489] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.578102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.578218] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 321cefa0-5927-4827-bb54-946d4d4296b8 is going to be deleted. [ 1371.578974] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.579176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.607931] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.608061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.608718] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.608812] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.625137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.625256] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd51d8a4-0c41-4e95-a3e3-1f0da556ee84 is going to be deleted. [ 1371.626216] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.626419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.634266] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.634359] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.648707] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.648834] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f64a4b87-9b99-4306-97e4-e97d2b7d7388 is going to be deleted. [ 1371.649590] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.649786] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.697562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.697684] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54f2e457-46a8-40bd-9513-a556b213a51c is going to be deleted. [ 1371.698589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.698787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.739763] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.739893] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.744422] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.744547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.780451] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.780554] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 558602f0-d46e-4c1e-9820-0cf4971db17b is going to be deleted. [ 1371.781380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.781632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.857600] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.857727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.858169] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.858279] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 472e5966-9eb6-4e5f-91b6-9f0b0df9c87e is going to be deleted. [ 1371.859629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.859843] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.904985] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.905132] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a80d85d-9154-4a27-bab2-481460122696 is going to be deleted. [ 1371.906008] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.906227] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.971347] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.972306] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.983819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.983947] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07670245-7199-41ee-bb6c-b1ff49af92c4 is going to be deleted. [ 1371.985417] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.985520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.985622] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.985787] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.985893] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.986031] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-558602f0-d46e-4c1e-9820-0cf4971db17b" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.986480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.986480] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.041278] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.041411] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2102ed9-efb2-4a2c-a170-b1e7872f4215 is going to be deleted. [ 1372.042289] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.042529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.087088] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.087205] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.088245] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.088360] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34fcdf94-41b1-46a2-ad09-83aa96da571c is going to be deleted. [ 1372.089164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.089360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.147585] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.147721] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.156530] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.156659] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.167797] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.167904] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.181547] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.181667] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81a99be3-2c8a-42ba-8c6c-44364c3737d8 is going to be deleted. [ 1372.182623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.182828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.231143] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.231516] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.308875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.309021] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb60d30-acd9-42ec-9942-d71d6c7c14f6 is going to be deleted. [ 1372.310033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.310292] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.338061] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.338176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.396675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.396808] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec67cf45-130c-446e-bc7a-8c1eb32450c7 is going to be deleted. [ 1372.397703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.397916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.473581] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d11a036c-e695-48d0-bc8a-32f7a8cd8485: rpc.has_security_group_logging(os_id): False [ 1372.474681] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8: rpc.has_security_group_logging(os_id): False [ 1372.522820] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.522991] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.523724] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.523821] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.527499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.527625] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7b1a811-2cde-4056-af4d-31f7ea781dba is going to be deleted. [ 1372.528515] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.528798] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.528911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.529077] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a246dbb9-bbe3-4f92-8823-3c958f77d63e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.529268] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.529499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.529608] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.529864] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50bad828-a4cc-463b-9c54-306ad5358f8d" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.531424] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.531601] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.531740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.531964] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.532117] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.532647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb60d30-acd9-42ec-9942-d71d6c7c14f6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.532826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.533025] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.533146] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.533296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-321cefa0-5927-4827-bb54-946d4d4296b8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.533469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.533690] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.533788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.533932] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f64a4b87-9b99-4306-97e4-e97d2b7d7388" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.534133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.534360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.534478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.534672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd51d8a4-0c41-4e95-a3e3-1f0da556ee84" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.534842] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.535032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.535145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.535288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54f2e457-46a8-40bd-9513-a556b213a51c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.535453] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.535631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.568535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.568714] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad2cbd17-afe0-45e7-973d-4380ccd03877 is going to be deleted. [ 1372.569792] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.570076] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.570193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.570325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a80d85d-9154-4a27-bab2-481460122696" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.570558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.570733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.570852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.571010] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07670245-7199-41ee-bb6c-b1ff49af92c4" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.571675] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.571912] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.572070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.572251] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2102ed9-efb2-4a2c-a170-b1e7872f4215" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.572565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.572874] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.572943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.573111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34fcdf94-41b1-46a2-ad09-83aa96da571c" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.573318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.573559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.573712] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.573896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81a99be3-2c8a-42ba-8c6c-44364c3737d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.575067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.575067] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.588372] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.588540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.626164] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.626594] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.626764] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.626856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.627154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.627334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.627483] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 is going to be updated. [ 1372.628623] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.628847] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.645906] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.646062] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.680768] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.680996] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.685927] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.686250] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.686376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.686474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.686684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.686803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.686927] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 is going to be updated. [ 1372.688263] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.688485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.688617] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.688775] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec67cf45-130c-446e-bc7a-8c1eb32450c7" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.688944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.689154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.689270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.689416] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-472e5966-9eb6-4e5f-91b6-9f0b0df9c87e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.689594] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.689776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.689888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.690036] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7b1a811-2cde-4056-af4d-31f7ea781dba" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.690183] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.690366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.690469] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.690611] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad2cbd17-afe0-45e7-973d-4380ccd03877" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.765311] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.765698] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.765784] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.766016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.766178] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.806650] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 in Status: IN_PROGRESS for 2s [ 1372.825677] env[69777]: INFO networking_nsxv3.common.synchronization [req-95631600-18f3-4ace-b42f-1866890701dd req-6815e5f9-7c7a-4c07-bae2-a0c59af75b7c tempest-ServerActionsTestJSON-2034218311 tempest-ServerActionsTestJSON-2034218311-project-member] Enqueued Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1372.826380] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94c1310-5466-4ce7-9d83-c7c474aa637e with Priority: HIGHEST for action security_group_members [ 1372.826847] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d94c1310-5466-4ce7-9d83-c7c474aa637e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.826982] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.827073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.827283] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.827464] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.827570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.827794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.827794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.827921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.827963] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d94c1310-5466-4ce7-9d83-c7c474aa637e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.836572] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.836729] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.836759] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.836920] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.837071] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.859055] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 in Status: IN_PROGRESS for 2s [ 1373.332133] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.332133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.332133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.332133] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.347061] env[69777]: INFO networking_nsxv3.common.synchronization [None req-d47c229a-7b17-443b-95d9-9c8e0aad1091 None None] Enqueued Resource ID: 8297f3e6-abbf-418d-afdf-5e8b3616a8d8 with Priority: HIGHEST for action port [ 1373.347061] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8297f3e6-abbf-418d-afdf-5e8b3616a8d8 with Priority: HIGHEST for action port [ 1373.347061] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-8297f3e6-abbf-418d-afdf-5e8b3616a8d8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.347061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8297f3e6-abbf-418d-afdf-5e8b3616a8d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.347061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8297f3e6-abbf-418d-afdf-5e8b3616a8d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.347061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8297f3e6-abbf-418d-afdf-5e8b3616a8d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.347061] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8297f3e6-abbf-418d-afdf-5e8b3616a8d8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.352170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.352170] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.352170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.352170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.352170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.352170] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.352170] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e is going to be updated. [ 1373.374924] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.374924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.374924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.374924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.374924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.380521] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: IN_PROGRESS for 2s [ 1373.849957] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8297f3e6-abbf-418d-afdf-5e8b3616a8d8 [ 1373.850212] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.850349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.850419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.850639] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.850743] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.850837] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8297f3e6-abbf-418d-afdf-5e8b3616a8d8 already deleted. [ 1373.850917] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8297f3e6-abbf-418d-afdf-5e8b3616a8d8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.822011] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 in Status: SUCCESS [ 1374.822305] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.870042] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 in Status: SUCCESS [ 1374.870042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.359837] env[69777]: INFO networking_nsxv3.common.synchronization [None req-bc4e3f20-1419-48a7-846c-0f3e15382b87 None None] Enqueued Resource ID: c9a30af2-eb6b-4fab-9d3b-a3193bf9a633 with Priority: HIGHEST for action port [ 1375.359837] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9a30af2-eb6b-4fab-9d3b-a3193bf9a633 with Priority: HIGHEST for action port [ 1375.359837] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9a30af2-eb6b-4fab-9d3b-a3193bf9a633 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.359837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9a30af2-eb6b-4fab-9d3b-a3193bf9a633" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.359837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9a30af2-eb6b-4fab-9d3b-a3193bf9a633" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.359837] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9a30af2-eb6b-4fab-9d3b-a3193bf9a633" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.359837] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9a30af2-eb6b-4fab-9d3b-a3193bf9a633',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.390387] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d94c1310-5466-4ce7-9d83-c7c474aa637e in Status: SUCCESS [ 1375.390387] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d94c1310-5466-4ce7-9d83-c7c474aa637e deletion is rescheduled due to dependency. [ 1375.390387] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d94c1310-5466-4ce7-9d83-c7c474aa637e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.862424] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9a30af2-eb6b-4fab-9d3b-a3193bf9a633 [ 1375.862674] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.862819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.862921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.863185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.863281] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.863386] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9a30af2-eb6b-4fab-9d3b-a3193bf9a633 already deleted. [ 1375.863479] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9a30af2-eb6b-4fab-9d3b-a3193bf9a633" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.315527] env[69777]: INFO networking_nsxv3.common.synchronization [req-e1bbb9ec-5ac8-43d8-ba7b-3c6ebd4ec3e5 req-1d946798-33b6-47ed-b4bb-72dc988dc961 tempest-ServerRescueTestJSON-511512233 tempest-ServerRescueTestJSON-511512233-project-member] Enqueued Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1379.315899] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1379.316219] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.316344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.316476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.317214] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.317214] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.317214] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.317214] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.317214] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.317214] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.317391] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.594629] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-953 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.596467] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.596467] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.596467] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.596467] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.597208] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.597477] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.597796] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.598065] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.598793] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1379.600998] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1379.600998] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1379.600998] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1379.600998] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1379.600998] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1379.600998] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1379.618359] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1379.618660] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1379.618931] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1379.619219] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.619587] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.619909] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.620160] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.620741] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.621518] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.822107] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.822270] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.822346] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.822631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.822731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.822951] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.823073] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.823139] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.823290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.823367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.823471] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9c831b-b891-45f9-ba30-065286c9f41e already deleted. [ 1379.823558] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.127019] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.127019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.127019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.127019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.127019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.127019] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be not found, creating... [ 1380.127019] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.127019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.127019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.127019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.127019] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.127497] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.127497] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.128112] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.128485] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.128742] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.128990] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be is going to be created. [ 1380.149240] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.149446] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.149629] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.149805] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.149969] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.150208] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.514020] env[69777]: INFO networking_nsxv3.common.synchronization [None req-8e2b6452-bca0-4013-8162-52c73b3f0626 None None] Enqueued Resource ID: cd243154-2e9f-4fff-8751-f59934914ebd with Priority: HIGHEST for action port [ 1380.514020] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd243154-2e9f-4fff-8751-f59934914ebd with Priority: HIGHEST for action port [ 1380.514020] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd243154-2e9f-4fff-8751-f59934914ebd taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.514020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd243154-2e9f-4fff-8751-f59934914ebd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.514020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd243154-2e9f-4fff-8751-f59934914ebd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.514020] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd243154-2e9f-4fff-8751-f59934914ebd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.514578] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd243154-2e9f-4fff-8751-f59934914ebd',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.823338] env[69777]: INFO networking_nsxv3.common.synchronization [req-e1bbb9ec-5ac8-43d8-ba7b-3c6ebd4ec3e5 req-4460df3a-bad5-44ad-a84b-67e424220fe5 service nova] Enqueued Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_rules [ 1380.823338] env[69777]: INFO networking_nsxv3.common.synchronization [req-e1bbb9ec-5ac8-43d8-ba7b-3c6ebd4ec3e5 req-4460df3a-bad5-44ad-a84b-67e424220fe5 service nova] Enqueued Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1380.823338] env[69777]: INFO networking_nsxv3.common.synchronization [req-e1bbb9ec-5ac8-43d8-ba7b-3c6ebd4ec3e5 req-4460df3a-bad5-44ad-a84b-67e424220fe5 service nova] Enqueued Resource ID: ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be with Priority: HIGHEST for action port [ 1380.824217] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_rules [ 1380.824871] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1380.825191] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be with Priority: HIGHEST for action port [ 1380.825866] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.826544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.826544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.826921] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.827170] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.829052] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.829052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.829052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.829518] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.829900] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.830957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.830957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.830957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.830957] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.830957] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.832011] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.832465] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.832626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.833297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.833880] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.017071] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd243154-2e9f-4fff-8751-f59934914ebd [ 1381.017071] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.017235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.017235] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.017452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.017543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.017641] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd243154-2e9f-4fff-8751-f59934914ebd already deleted. [ 1381.017723] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd243154-2e9f-4fff-8751-f59934914ebd" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.336627] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.336627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.336627] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.337397] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be with status ACTIVE [ 1381.337589] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.337727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.337785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.338361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.338361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.338470] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.338470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.338584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.338681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.338757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.338941] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.339052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.339118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.339254] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.339327] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.339410] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be is going to be updated. [ 1381.363604] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.363733] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.363804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.363988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.364137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.364288] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ded22f1f-6c40-4fdd-b6a9-65a3c4fd53be" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.842069] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.346351] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.346514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.346586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.346806] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.346882] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.346981] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9c831b-b891-45f9-ba30-065286c9f41e is going to be created. [ 1382.369487] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.369686] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.369795] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.370058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.370279] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.378879] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: UNINITIALIZED for 2s [ 1382.515443] env[69777]: INFO networking_nsxv3.common.synchronization [None req-b20f224a-8b19-41e9-b7bf-78dd4b358600 None None] Enqueued Resource ID: 2d42ebbe-6728-498d-83aa-2b5fc7eba3a2 with Priority: HIGHEST for action port [ 1382.516596] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d42ebbe-6728-498d-83aa-2b5fc7eba3a2 with Priority: HIGHEST for action port [ 1382.517113] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d42ebbe-6728-498d-83aa-2b5fc7eba3a2 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.517296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d42ebbe-6728-498d-83aa-2b5fc7eba3a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.517408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d42ebbe-6728-498d-83aa-2b5fc7eba3a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.517769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d42ebbe-6728-498d-83aa-2b5fc7eba3a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.517902] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d42ebbe-6728-498d-83aa-2b5fc7eba3a2',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.020357] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d42ebbe-6728-498d-83aa-2b5fc7eba3a2 [ 1383.020663] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.020753] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.022013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.022013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.022013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.022013] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d42ebbe-6728-498d-83aa-2b5fc7eba3a2 already deleted. [ 1383.022013] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d42ebbe-6728-498d-83aa-2b5fc7eba3a2" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.403941] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: SUCCESS [ 1384.404193] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.404349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.404584] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.404857] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.404990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.405070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.405222] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.405301] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.405385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.405473] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.907794] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.907794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.907794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.908009] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.908124] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.908230] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.908294] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.908441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.908535] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.908628] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.908772] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.908863] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.908924] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.909075] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.909207] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.909296] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.909355] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.909493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.909562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.909640] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.909725] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.412571] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad9c831b-b891-45f9-ba30-065286c9f41e: rpc.has_security_group_logging(os_id): False [ 1385.432029] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.432029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.432029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.432029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.432029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.432029] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.432029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.432029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.432029] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.432418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.432418] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.432418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.432418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.432642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.432762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.432985] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.433102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.433168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.433325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.433402] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.433509] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad9c831b-b891-45f9-ba30-065286c9f41e is going to be created. [ 1385.486685] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.486860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.486860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.487470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.487470] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.497436] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: IN_PROGRESS for 2s [ 1386.524533] env[69777]: INFO networking_nsxv3.common.synchronization [req-6f5295be-9530-4797-b8cc-672e26a5c387 req-5429f248-32bb-4840-bba2-1f12e78ebeee tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1386.524971] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1386.525306] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.525431] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.525499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.525802] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.525966] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.526419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.526419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.526419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.526727] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.526846] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.777841] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-662 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.778135] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-662" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.778274] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-662" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.778605] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-662" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.778877] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.779055] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.779179] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.779437] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.779611] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.779835] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1386.779951] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1386.780078] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1386.780277] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1386.780335] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1386.780425] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1386.780575] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1386.798117] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1386.798308] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1386.798464] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1386.798658] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-662" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.798977] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-dda16f70-0174-4532-b0de-82455cb40599 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.799191] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.799330] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.799645] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.799794] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dda16f70-0174-4532-b0de-82455cb40599',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.030141] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.030335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.030335] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.030572] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.030646] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.030862] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.030963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.031051] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.031207] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.031295] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.031384] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 already deleted. [ 1387.031464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.301756] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.301989] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.302135] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.302428] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.302686] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.302893] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port dda16f70-0174-4532-b0de-82455cb40599 not found, creating... [ 1387.303183] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.303349] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.303533] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.303783] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.303963] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.304300] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.304494] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.304625] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.304858] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.305039] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.305199] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: dda16f70-0174-4532-b0de-82455cb40599 is going to be created. [ 1387.324643] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.324966] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.325191] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.325577] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.325927] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.326253] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.453444] env[69777]: INFO networking_nsxv3.common.synchronization [req-f7c5f6f8-2bf4-43cf-92f0-f6b0b63597d2 req-39483c49-bec5-4df6-b384-729e028a4613 tempest-AttachVolumeTestJSON-202711453 tempest-AttachVolumeTestJSON-202711453-project-member] Enqueued Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_members [ 1387.454155] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 with Priority: HIGHEST for action security_group_members [ 1387.454320] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11a036c-e695-48d0-bc8a-32f7a8cd8485 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.454444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.454514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.454714] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.454871] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.454971] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.455046] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.455381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.455381] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.455381] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d11a036c-e695-48d0-bc8a-32f7a8cd8485',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.511077] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: SUCCESS [ 1387.511362] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.957576] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.957959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.957959] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.958058] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.958501] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.958588] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.958717] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.958770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.958960] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.959070] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.959174] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 is going to be updated. [ 1387.984976] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.985141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.985211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.985418] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.985553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.993366] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 in Status: IN_PROGRESS for 2s [ 1388.018397] env[69777]: INFO networking_nsxv3.common.synchronization [req-6f5295be-9530-4797-b8cc-672e26a5c387 req-8642eda1-c0b5-4cd4-aa9e-2c021904e37e service nova] Enqueued Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_rules [ 1388.018540] env[69777]: INFO networking_nsxv3.common.synchronization [req-6f5295be-9530-4797-b8cc-672e26a5c387 req-8642eda1-c0b5-4cd4-aa9e-2c021904e37e service nova] Enqueued Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1388.018689] env[69777]: INFO networking_nsxv3.common.synchronization [req-6f5295be-9530-4797-b8cc-672e26a5c387 req-8642eda1-c0b5-4cd4-aa9e-2c021904e37e service nova] Enqueued Resource ID: dda16f70-0174-4532-b0de-82455cb40599 with Priority: HIGHEST for action port [ 1388.019215] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_rules [ 1388.019391] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1388.019499] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda16f70-0174-4532-b0de-82455cb40599 with Priority: HIGHEST for action port [ 1388.019773] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.019911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.019944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.020211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.020296] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.021211] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.021309] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.021376] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.021546] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.021688] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.021782] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.021845] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.022008] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.022078] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.022166] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.022917] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-dda16f70-0174-4532-b0de-82455cb40599 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.026436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.026550] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.026722] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.026804] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dda16f70-0174-4532-b0de-82455cb40599',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.528086] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.529147] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.529259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.529619] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dda16f70-0174-4532-b0de-82455cb40599 with status ACTIVE [ 1388.529975] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.530102] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.530165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.530368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.530484] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.530703] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.530805] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.530869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.531039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.531168] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.531295] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.531386] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.531446] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.531582] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.531655] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.531737] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dda16f70-0174-4532-b0de-82455cb40599 is going to be updated. [ 1388.552113] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.552233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.552307] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.552439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.552626] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.552776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.030912] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.533772] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.533939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.534033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.534262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.534354] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.534459] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 is going to be created. [ 1389.556957] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.557211] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.557337] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.557646] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.557896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.568209] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: UNINITIALIZED for 2s [ 1390.003894] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 in Status: SUCCESS [ 1390.004098] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11a036c-e695-48d0-bc8a-32f7a8cd8485 deletion is rescheduled due to dependency. [ 1390.004212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11a036c-e695-48d0-bc8a-32f7a8cd8485" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.848539] env[69777]: INFO networking_nsxv3.common.synchronization [req-90d94d8e-af73-4852-81a9-5424915f6c5b req-5694af65-330e-4224-b852-4bc77df6ed4a tempest-AttachVolumeNegativeTest-36388711 tempest-AttachVolumeNegativeTest-36388711-project-member] Enqueued Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_members [ 1390.848775] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 with Priority: HIGHEST for action security_group_members [ 1390.849289] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.849445] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.849520] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.849769] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.849953] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.850079] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.850151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.850545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.850545] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.850545] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.353065] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.353065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.353328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.353410] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.353542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.353803] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.353935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.354050] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.354246] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.354363] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.354475] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 is going to be updated. [ 1391.383315] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.383531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.383531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.383823] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.383977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.391886] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 in Status: IN_PROGRESS for 2s [ 1391.577503] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: SUCCESS [ 1391.577726] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.577881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.578141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.578291] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.578409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.578476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.578630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.578736] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.578794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.578886] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.081519] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.081807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.081807] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.081963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.083811] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.083939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.083999] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.084192] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.084280] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.084372] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.084532] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.084627] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.084688] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.084868] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.084956] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.085064] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.085116] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.085253] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.085339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.085449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.085544] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.180194] env[69777]: INFO networking_nsxv3.common.synchronization [None req-f37386b5-e669-4bde-82dd-455795fb7fed tempest-AttachVolumeTestJSON-202711453 tempest-AttachVolumeTestJSON-202711453-project-member] Enqueued Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_rules [ 1392.180194] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_rules [ 1392.180194] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.180552] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.180748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.181165] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.181391] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('484efcb5-0d6f-4695-805f-26ba73a7b1fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.263860] env[69777]: INFO networking_nsxv3.common.synchronization [None req-d8a9898e-7ce6-485b-8c72-3fc9e89ef882 tempest-AttachVolumeTestJSON-202711453 tempest-AttachVolumeTestJSON-202711453-project-member] Enqueued Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_rules [ 1392.264518] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_rules [ 1392.264899] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.265981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.588431] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c41b31b-24c5-4383-b3fc-e821a3722fc6: rpc.has_security_group_logging(os_id): False [ 1392.606390] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.606938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.606938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.606938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.606938] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.607095] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.607143] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.607201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.607339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.607420] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.607604] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.607699] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.607762] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.607902] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.607973] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.608174] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.608267] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.608329] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.608464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.608537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.608620] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 is going to be created. [ 1392.681519] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.681678] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.681750] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.681968] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.682167] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.707059] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: IN_PROGRESS for 2s [ 1392.714469] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.714642] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.714745] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.715069] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.715189] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.715310] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc already deleted. [ 1392.715419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.715586] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.715770] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.715876] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('484efcb5-0d6f-4695-805f-26ba73a7b1fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.237048] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.237370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.237370] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.237499] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.237574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.237679] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc already deleted. [ 1393.237765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.402455] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 in Status: SUCCESS [ 1393.402735] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8 deletion is rescheduled due to dependency. [ 1393.402875] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dc427e5-af53-4fe2-9e05-fcb54b7ec1f8" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.719125] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: SUCCESS [ 1394.719442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.265316] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.265637] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.484433] env[69777]: INFO networking_nsxv3.common.synchronization [req-1efdf68d-573b-425b-b623-ad68b0d9824b req-34353dd5-ab46-4a7b-ac21-a2ec62860a27 tempest-AttachVolumeTestJSON-202711453 tempest-AttachVolumeTestJSON-202711453-project-member] Enqueued Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_members [ 1397.485009] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_members [ 1397.485335] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-484efcb5-0d6f-4695-805f-26ba73a7b1fc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.485876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.485876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.486118] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.486281] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.486366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.486444] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.486593] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.486669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.486733] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('484efcb5-0d6f-4695-805f-26ba73a7b1fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.764578] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.764798] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-435" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.764952] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-435" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.765366] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-435" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.765531] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.765730] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.765882] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.766049] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.766210] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.766431] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1397.766548] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1397.766704] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1397.766834] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1397.766954] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1397.767084] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1397.767224] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1397.787480] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1397.787646] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1397.787787] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1397.787972] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-435" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.788447] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-230dcc8f-e970-43ac-958e-d177ceb4f265 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.788447] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-230dcc8f-e970-43ac-958e-d177ceb4f265" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.788613] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-230dcc8f-e970-43ac-958e-d177ceb4f265" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.788885] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-230dcc8f-e970-43ac-958e-d177ceb4f265" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.789332] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('230dcc8f-e970-43ac-958e-d177ceb4f265',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.988953] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.989217] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.989302] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.989522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.989618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.989819] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.989922] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.989988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.990152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.990233] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.990351] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc already deleted. [ 1397.990452] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.293640] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.294045] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.294091] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.294400] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.294574] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.294773] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 230dcc8f-e970-43ac-958e-d177ceb4f265 not found, creating... [ 1398.295108] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.295297] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.295453] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.295694] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.295874] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.296243] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.296453] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.296635] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.296858] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.297025] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.297204] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 230dcc8f-e970-43ac-958e-d177ceb4f265 is going to be created. [ 1398.317377] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.317625] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.317787] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.318105] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.318363] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.318601] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-230dcc8f-e970-43ac-958e-d177ceb4f265" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.030625] env[69777]: INFO networking_nsxv3.common.synchronization [req-1efdf68d-573b-425b-b623-ad68b0d9824b req-07769a47-6922-4208-bf45-8f59e3a9c58d service nova] Enqueued Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_rules [ 1399.030816] env[69777]: INFO networking_nsxv3.common.synchronization [req-1efdf68d-573b-425b-b623-ad68b0d9824b req-07769a47-6922-4208-bf45-8f59e3a9c58d service nova] Enqueued Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_members [ 1399.030963] env[69777]: INFO networking_nsxv3.common.synchronization [req-1efdf68d-573b-425b-b623-ad68b0d9824b req-07769a47-6922-4208-bf45-8f59e3a9c58d service nova] Enqueued Resource ID: 230dcc8f-e970-43ac-958e-d177ceb4f265 with Priority: HIGHEST for action port [ 1399.031205] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_rules [ 1399.031336] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_members [ 1399.031435] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 230dcc8f-e970-43ac-958e-d177ceb4f265 with Priority: HIGHEST for action port [ 1399.036126] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.036320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.036367] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.036580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.037284] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('484efcb5-0d6f-4695-805f-26ba73a7b1fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.038100] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-484efcb5-0d6f-4695-805f-26ba73a7b1fc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.039024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.039024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.039024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.039024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.039024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.039024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.039024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.039024] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.039024] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('484efcb5-0d6f-4695-805f-26ba73a7b1fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.039775] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-230dcc8f-e970-43ac-958e-d177ceb4f265 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.039872] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-230dcc8f-e970-43ac-958e-d177ceb4f265" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.039944] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-230dcc8f-e970-43ac-958e-d177ceb4f265" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.040111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-230dcc8f-e970-43ac-958e-d177ceb4f265" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.040187] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('230dcc8f-e970-43ac-958e-d177ceb4f265',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.542122] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-484efcb5-0d6f-4695-805f-26ba73a7b1fc taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.542443] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.543870] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('484efcb5-0d6f-4695-805f-26ba73a7b1fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.544994] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 230dcc8f-e970-43ac-958e-d177ceb4f265 with status ACTIVE [ 1399.545336] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.545487] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.545570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.545776] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.545870] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.546053] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.546154] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.546218] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.546379] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.546457] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.546635] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.546740] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.546803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.546943] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.547021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.547109] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 230dcc8f-e970-43ac-958e-d177ceb4f265 is going to be updated. [ 1399.568545] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.568672] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.568746] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.568898] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.569038] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.569190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-230dcc8f-e970-43ac-958e-d177ceb4f265" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.045439] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('484efcb5-0d6f-4695-805f-26ba73a7b1fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.548052] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.548052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.548052] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.548449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.548449] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.548449] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc is going to be created. [ 1400.572998] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.573148] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.573241] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.573392] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.573544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.582151] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc in Status: UNINITIALIZED for 2s [ 1401.456500] env[69777]: INFO networking_nsxv3.common.synchronization [req-d1c5a1f5-3e2d-4c12-b9e0-cbc5435c3d70 req-a0b21f4f-37a3-4473-b8ea-cad1d64cb839 tempest-ServerRescueTestJSON-511512233 tempest-ServerRescueTestJSON-511512233-project-member] Enqueued Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1401.456596] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1401.457175] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.457175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.457175] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.457422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.457422] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.457532] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.457581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.457704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.457788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.457878] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.960321] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.973657] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock network-953 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.974212] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.974212] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.974301] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.974596] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.974790] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.974945] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.975215] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.975405] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.975654] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1401.975796] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] NeedRegenerationException {{(pid=69777) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1401.975937] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] no value, waiting for create lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1401.976085] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] value creation lock acquired {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1401.976233] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] No value present for key: 'zone-id' {{(pid=69777) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1401.976368] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Calling creation function for not-yet-present value {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1401.976529] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1401.994676] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1401.994871] env[69777]: DEBUG dogpile.cache.region [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69777) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1401.995073] env[69777]: DEBUG dogpile.lock [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Released creation lock {{(pid=69777) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1401.995283] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "network-953" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.995587] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock port-1baec7b5-9700-44ab-9848-25819091fc82 taken with stack trace [, , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.995798] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "port-1baec7b5-9700-44ab-9848-25819091fc82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.995953] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "port-1baec7b5-9700-44ab-9848-25819091fc82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.996288] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "port-1baec7b5-9700-44ab-9848-25819091fc82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.996458] env[69777]: DEBUG networking_nsxv3.api.rpc [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1baec7b5-9700-44ab-9848-25819091fc82',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.462369] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.498878] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.499148] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.499233] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.499549] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.499741] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.499913] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Segment Port 1baec7b5-9700-44ab-9848-25819091fc82 not found, creating... [ 1402.500257] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.500423] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.500554] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.500778] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.500921] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.501223] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.501385] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.501506] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.501726] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.501860] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.502012] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Resource: SegmentPort with ID: 1baec7b5-9700-44ab-9848-25819091fc82 is going to be created. [ 1402.526013] env[69777]: DEBUG networking_nsxv3.common.locking [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.526225] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.526355] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.526609] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.526841] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.527099] env[69777]: DEBUG oslo_concurrency.lockutils [None req-d5eb3d0d-5463-4dfb-a1f1-ebcb90c61d35 None None] Releasing lock "port-1baec7b5-9700-44ab-9848-25819091fc82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.592653] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc in Status: SUCCESS [ 1402.592888] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.593061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.593266] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.593453] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.593566] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.593632] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.593789] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.593867] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.593952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.594053] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('484efcb5-0d6f-4695-805f-26ba73a7b1fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.965883] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.966331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.966331] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.966397] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.966534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.966648] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9c831b-b891-45f9-ba30-065286c9f41e is going to be updated. [ 1402.998302] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.998514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.998592] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.998829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.998988] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.006904] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: IN_PROGRESS for 2s [ 1403.096480] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('484efcb5-0d6f-4695-805f-26ba73a7b1fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.227536] env[69777]: INFO networking_nsxv3.common.synchronization [req-d1c5a1f5-3e2d-4c12-b9e0-cbc5435c3d70 req-9c7ba3d4-6269-4d56-a28d-17952dd70735 service nova] Enqueued Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_rules [ 1403.227536] env[69777]: INFO networking_nsxv3.common.synchronization [req-d1c5a1f5-3e2d-4c12-b9e0-cbc5435c3d70 req-9c7ba3d4-6269-4d56-a28d-17952dd70735 service nova] Enqueued Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1403.227536] env[69777]: INFO networking_nsxv3.common.synchronization [req-d1c5a1f5-3e2d-4c12-b9e0-cbc5435c3d70 req-9c7ba3d4-6269-4d56-a28d-17952dd70735 service nova] Enqueued Resource ID: 1baec7b5-9700-44ab-9848-25819091fc82 with Priority: HIGHEST for action port [ 1403.228492] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_rules [ 1403.228801] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1403.229079] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1baec7b5-9700-44ab-9848-25819091fc82 with Priority: HIGHEST for action port [ 1403.229786] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.230111] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.230317] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.230704] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.231030] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.232693] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.232693] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.232693] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-1baec7b5-9700-44ab-9848-25819091fc82 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.232899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1baec7b5-9700-44ab-9848-25819091fc82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.232899] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1baec7b5-9700-44ab-9848-25819091fc82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.233151] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1baec7b5-9700-44ab-9848-25819091fc82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.233292] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1baec7b5-9700-44ab-9848-25819091fc82',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.599253] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 484efcb5-0d6f-4695-805f-26ba73a7b1fc: rpc.has_security_group_logging(os_id): False [ 1403.616127] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.616344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.616344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.616570] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.616658] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.616934] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.617053] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.617121] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.617271] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.617349] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.617468] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc is going to be created. [ 1403.672830] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.673030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.673074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.673261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.673442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.682856] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc in Status: IN_PROGRESS for 2s [ 1403.735427] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.735554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.737864] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1baec7b5-9700-44ab-9848-25819091fc82 with status ACTIVE [ 1403.738058] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.738188] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.738257] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.738464] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.738554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.738734] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.738832] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.738896] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.739061] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.739142] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.739321] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.739413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.739475] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.739612] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.739689] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.739775] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1baec7b5-9700-44ab-9848-25819091fc82 is going to be updated. [ 1403.771902] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.772101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.772101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.772306] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.772439] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.772647] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1baec7b5-9700-44ab-9848-25819091fc82" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.861407] env[69777]: INFO networking_nsxv3.common.synchronization [req-46285537-81f3-4f03-99b9-e03fbe69383e req-7cebdfea-fa51-4ff7-8496-f1c1706981fb tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 with Priority: HIGHEST for action security_group_members [ 1404.861772] env[69777]: INFO networking_nsxv3.common.synchronization [req-46285537-81f3-4f03-99b9-e03fbe69383e req-7cebdfea-fa51-4ff7-8496-f1c1706981fb tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1404.862107] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 with Priority: HIGHEST for action security_group_members [ 1404.862247] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1404.862514] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a38357-2853-4a6d-b7ff-a176493e7ce0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.862810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.862810] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.863012] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.863178] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.863261] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.863344] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.863476] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.863559] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.863674] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a38357-2853-4a6d-b7ff-a176493e7ce0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.864481] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.864583] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.864650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.864803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.864941] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.865083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.865145] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.865290] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.865497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.865497] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.905877] env[69777]: INFO networking_nsxv3.common.synchronization [req-46285537-81f3-4f03-99b9-e03fbe69383e req-7cebdfea-fa51-4ff7-8496-f1c1706981fb tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 with Priority: HIGHEST for action security_group_rules [ 1404.906102] env[69777]: INFO networking_nsxv3.common.synchronization [req-46285537-81f3-4f03-99b9-e03fbe69383e req-7cebdfea-fa51-4ff7-8496-f1c1706981fb tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 with Priority: HIGHEST for action security_group_members [ 1404.906301] env[69777]: INFO networking_nsxv3.common.synchronization [req-46285537-81f3-4f03-99b9-e03fbe69383e req-7cebdfea-fa51-4ff7-8496-f1c1706981fb tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_rules [ 1404.906388] env[69777]: INFO networking_nsxv3.common.synchronization [req-46285537-81f3-4f03-99b9-e03fbe69383e req-7cebdfea-fa51-4ff7-8496-f1c1706981fb tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1404.906525] env[69777]: INFO networking_nsxv3.common.synchronization [req-46285537-81f3-4f03-99b9-e03fbe69383e req-7cebdfea-fa51-4ff7-8496-f1c1706981fb tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: dda16f70-0174-4532-b0de-82455cb40599 with Priority: HIGHEST for action port [ 1404.906966] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 with Priority: HIGHEST for action security_group_rules [ 1404.907545] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_rules [ 1404.907738] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda16f70-0174-4532-b0de-82455cb40599 with Priority: HIGHEST for action port [ 1404.907789] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 with Priority: HIGHEST for action security_group_members [ 1404.907855] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1404.908127] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15a38357-2853-4a6d-b7ff-a176493e7ce0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.908282] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.908334] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.908565] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.908646] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15a38357-2853-4a6d-b7ff-a176493e7ce0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.909493] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.909557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.909635] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.909788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.909865] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.912460] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-dda16f70-0174-4532-b0de-82455cb40599 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.912681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.912681] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.912829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.912902] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dda16f70-0174-4532-b0de-82455cb40599',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.913640] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a38357-2853-4a6d-b7ff-a176493e7ce0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.913763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.913972] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.914074] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.015730] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: SUCCESS [ 1405.015963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.016136] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.016393] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.016534] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.016651] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.016720] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.016869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.016951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.017055] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.160832] env[69777]: INFO networking_nsxv3.common.synchronization [req-a5adb706-11d3-4662-a6f8-87895d138124 req-0f56bd9e-f272-4b3d-8d40-bc57579425bc tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 with Priority: HIGHEST for action security_group_members [ 1405.161159] env[69777]: INFO networking_nsxv3.common.synchronization [req-a5adb706-11d3-4662-a6f8-87895d138124 req-0f56bd9e-f272-4b3d-8d40-bc57579425bc tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1405.161639] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 with Priority: HIGHEST for action security_group_members [ 1405.161757] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1405.162229] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a38357-2853-4a6d-b7ff-a176493e7ce0 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.162361] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.162760] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.162869] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.205217] env[69777]: INFO networking_nsxv3.common.synchronization [req-a5adb706-11d3-4662-a6f8-87895d138124 req-0f56bd9e-f272-4b3d-8d40-bc57579425bc tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_rules [ 1405.205442] env[69777]: INFO networking_nsxv3.common.synchronization [req-a5adb706-11d3-4662-a6f8-87895d138124 req-0f56bd9e-f272-4b3d-8d40-bc57579425bc tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1405.205599] env[69777]: INFO networking_nsxv3.common.synchronization [req-a5adb706-11d3-4662-a6f8-87895d138124 req-0f56bd9e-f272-4b3d-8d40-bc57579425bc tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: dda16f70-0174-4532-b0de-82455cb40599 with Priority: HIGHEST for action port [ 1405.206101] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_rules [ 1405.206236] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1405.206386] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda16f70-0174-4532-b0de-82455cb40599 with Priority: HIGHEST for action port [ 1405.206669] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.206778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.207072] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.207131] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.207325] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock port-dda16f70-0174-4532-b0de-82455cb40599 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.207407] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.367065] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15a38357-2853-4a6d-b7ff-a176493e7ce0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.368017] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.415557] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a38357-2853-4a6d-b7ff-a176493e7ce0 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.415695] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.417697] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.417697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.417697] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dda16f70-0174-4532-b0de-82455cb40599 with status ACTIVE [ 1405.417697] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.417697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.417697] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.417940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.417940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.418117] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.418232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.418297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.418450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.418526] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.418704] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.418794] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.418852] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.418990] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.419101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.419195] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dda16f70-0174-4532-b0de-82455cb40599 is going to be updated. [ 1405.446832] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.447049] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.447130] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.447287] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.447429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.447589] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.447738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.447900] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.447974] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dda16f70-0174-4532-b0de-82455cb40599',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.519382] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.694811] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc in Status: SUCCESS [ 1405.695112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.870719] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15a38357-2853-4a6d-b7ff-a176493e7ce0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.872156] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.950664] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dda16f70-0174-4532-b0de-82455cb40599 with status ACTIVE [ 1405.950908] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.951054] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.951125] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.951339] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.951430] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.951604] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.951701] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.951765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.951916] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.952039] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.952187] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.952303] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.952365] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.952505] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.952579] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.952672] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dda16f70-0174-4532-b0de-82455cb40599 is going to be updated. [ 1405.972367] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.972569] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.972613] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.972860] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.972994] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.973166] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dda16f70-0174-4532-b0de-82455cb40599" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.021904] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.374386] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.374542] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.374624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.374841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.374939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.375063] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 is going to be created. [ 1406.376690] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.376793] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.376828] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.377011] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.381360] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.381464] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 is going to be updated. [ 1406.406052] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.406221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.406318] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.406557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.406757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.409261] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.409388] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.409436] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.410096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.410096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.416862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 in Status: UNINITIALIZED for 2s [ 1406.416862] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: IN_PROGRESS for 2s [ 1406.524014] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.524185] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.524255] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.524495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.524587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.524690] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9c831b-b891-45f9-ba30-065286c9f41e is going to be updated. [ 1406.555096] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.555096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.555096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.555096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.555096] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.563729] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: IN_PROGRESS for 2s [ 1408.426642] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: SUCCESS [ 1408.427037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.427037] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.427460] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.427714] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.427879] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.427977] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.428213] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.428326] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.428453] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.430158] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 in Status: SUCCESS [ 1408.430406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.430618] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.430826] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.430994] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.431115] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.431181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.431325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.431403] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.431493] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a38357-2853-4a6d-b7ff-a176493e7ce0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.572578] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: SUCCESS [ 1408.572856] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.573021] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.573225] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.573410] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.573525] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.573591] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.573748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.573825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.573911] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.574008] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.933469] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.934574] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.934728] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.934788] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.935140] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.935274] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.935485] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.935604] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.935674] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.935849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.935935] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.936038] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 is going to be deleted. [ 1409.000097] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.000259] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.000325] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.000539] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.000631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.000781] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.000946] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.001390] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.001390] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.001390] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.001537] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.001568] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.001643] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.001736] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a38357-2853-4a6d-b7ff-a176493e7ce0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.076340] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.076580] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.076705] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.076975] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.077224] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.077366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.077562] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.077731] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.077876] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.078042] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.078256] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.078408] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.078522] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.078724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.078923] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.079084] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.079212] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.079409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.079534] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.079680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.079831] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.437809] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.504332] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.504496] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.504574] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.504811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.504907] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.505117] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.505232] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.505297] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.505463] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.505544] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.505631] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 already deleted. [ 1409.505724] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.505878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.506057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.506216] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.506313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.506375] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.506529] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.506603] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.506697] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a38357-2853-4a6d-b7ff-a176493e7ce0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.582292] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad9c831b-b891-45f9-ba30-065286c9f41e: rpc.has_security_group_logging(os_id): False [ 1409.599785] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.599969] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.600101] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.600319] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.600437] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.600644] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.600748] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.600815] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.601030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.601112] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.601302] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.601419] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.601491] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.601684] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.601765] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.601988] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.602141] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.602221] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.602373] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.602474] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.602569] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad9c831b-b891-45f9-ba30-065286c9f41e is going to be updated. [ 1409.669756] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.669939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.669939] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.670269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.670556] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.683329] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: IN_PROGRESS for 2s [ 1409.942554] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.942554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.942554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.942554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.942554] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.942554] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 is going to be updated. [ 1409.972234] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.972429] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.972493] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.972778] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.973023] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.983399] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: IN_PROGRESS for 2s [ 1410.010401] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.010401] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.010401] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 already deleted. [ 1410.010401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.010401] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15a38357-2853-4a6d-b7ff-a176493e7ce0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.207360] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.207610] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 1410.512745] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15a38357-2853-4a6d-b7ff-a176493e7ce0',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.546097] env[69777]: INFO networking_nsxv3.common.synchronization [req-71bd193b-3dc7-4c06-acde-01946b475f58 req-8c861222-7254-4c56-8d72-a04e15d00dca tempest-ServerRescueTestJSONUnderV235-1508165214 tempest-ServerRescueTestJSONUnderV235-1508165214-project-member] Enqueued Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1410.546592] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 with Priority: HIGHEST for action security_group_members [ 1410.546904] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c41b31b-24c5-4383-b3fc-e821a3722fc6 taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.547016] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.014502] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15a38357-2853-4a6d-b7ff-a176493e7ce0: rpc.has_security_group_logging(os_id): False [ 1411.034917] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.035093] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.035161] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.035374] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.035450] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.035650] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.035738] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.035803] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.035948] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.036032] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.036118] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 is going to be created. [ 1411.051369] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/15a38357-2853-4a6d-b7ff-a176493e7ce0], does not exist path=[/infra/domains/default/groups/15a38357-2853-4a6d-b7ff-a176493e7ce0]."\n}' [ 1411.051481] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/15a38357-2853-4a6d-b7ff-a176493e7ce0 [ 1411.051528] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1411.082354] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.082497] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.082540] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.082749] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.083442] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.083699] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.083804] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.083871] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.084041] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.084120] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.084287] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.084380] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.084441] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.084576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.084650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.084734] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15a38357-2853-4a6d-b7ff-a176493e7ce0 is going to be created. [ 1411.098933] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/15a38357-2853-4a6d-b7ff-a176493e7ce0], does not exist path=[/infra/domains/default/groups/15a38357-2853-4a6d-b7ff-a176493e7ce0]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/15a38357-2853-4a6d-b7ff-a176493e7ce0 [ 1411.099065] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15a38357-2853-4a6d-b7ff-a176493e7ce0" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.099224] env[69777]: Traceback (most recent call last): [ 1411.099263] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1411.099263] env[69777]: return func(*args, **kwargs) [ 1411.099263] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1411.099263] env[69777]: res.raise_for_status() [ 1411.099263] env[69777]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1411.099263] env[69777]: raise HTTPError(http_error_msg, response=self) [ 1411.099263] env[69777]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/15a38357-2853-4a6d-b7ff-a176493e7ce0 [ 1411.099263] env[69777]: During handling of the above exception, another exception occurred: [ 1411.099263] env[69777]: Traceback (most recent call last): [ 1411.099507] env[69777]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1411.099507] env[69777]: listener.cb(fileno) [ 1411.099507] env[69777]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1411.099507] env[69777]: result = function(*args, **kwargs) [ 1411.099507] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1411.099507] env[69777]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1411.099507] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1411.099507] env[69777]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1411.099507] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1411.099507] env[69777]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1411.099507] env[69777]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1411.099507] env[69777]: res.raise_for_status() [ 1411.099507] env[69777]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1411.099507] env[69777]: raise HTTPError(http_error_msg, response=self) [ 1411.099507] env[69777]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/15a38357-2853-4a6d-b7ff-a176493e7ce0 [ 1411.099507] env[69777]: Removing descriptor: 69 [ 1411.694541] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: SUCCESS [ 1411.694541] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.993057] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: SUCCESS [ 1411.993057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.993057] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.993310] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.993465] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.993629] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.993703] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.993894] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.994011] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.994137] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.496759] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.496940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.496940] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.497176] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.517816] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.518086] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.518209] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.518278] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.518477] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.518561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.518651] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 is going to be updated. [ 1412.567840] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.567840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.567840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.567840] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.568152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.575470] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: IN_PROGRESS for 2s [ 1414.587158] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: SUCCESS [ 1414.587625] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 deletion is rescheduled due to dependency. [ 1414.587625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.587625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.587854] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.588024] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.588181] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.588273] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.588357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.588425] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.588529] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.091367] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.091597] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.091680] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.091901] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.091997] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.092222] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.092320] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.092385] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.092536] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.092614] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.092702] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 is going to be updated. [ 1415.124222] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.124332] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.124405] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.124631] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.124772] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.133443] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: IN_PROGRESS for 2s [ 1415.547744] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.547856] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1417.145103] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: SUCCESS [ 1417.145483] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 deletion is rescheduled due to dependency. [ 1417.145483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.145621] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.145881] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.146122] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.146264] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.146313] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.146478] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.146561] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.146650] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.146751] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.147656] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.147825] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.147996] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.148763] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.148849] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.149060] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.149152] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.149428] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.651450] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.651624] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.651669] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.651892] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.651986] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.652227] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.652328] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.652394] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.652546] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.652619] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.652707] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 is going to be updated. [ 1417.653870] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.680369] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.680514] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.680598] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.680819] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.680963] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.690521] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: IN_PROGRESS for 2s [ 1418.155853] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c41b31b-24c5-4383-b3fc-e821a3722fc6: rpc.has_security_group_logging(os_id): False [ 1418.173276] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.173438] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.173495] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.173739] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.174210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.174210] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.174210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.174210] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.174423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.174423] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.174505] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 is going to be updated. [ 1418.250812] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.250984] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.251083] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.251293] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.251422] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.276964] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: IN_PROGRESS for 2s [ 1419.699825] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: SUCCESS [ 1419.700190] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 deletion is rescheduled due to dependency. [ 1419.700190] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.291173] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 in Status: SUCCESS [ 1420.291409] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.291543] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.291785] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.291885] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c41b31b-24c5-4383-b3fc-e821a3722fc6',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.549163] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.549293] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1420.810518] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.810882] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.810882] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.810882] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.825092] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.825230] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c41b31b-24c5-4383-b3fc-e821a3722fc6 is going to be deleted. [ 1420.860422] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.860630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.860630] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.860829] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.860951] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.861030] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c41b31b-24c5-4383-b3fc-e821a3722fc6" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.550407] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.550756] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1427.512265] env[69777]: INFO networking_nsxv3.common.synchronization [req-ad32cfbf-0f21-4005-9e94-5263bb1675c4 req-1783c9cf-89fa-4434-89f0-4e6c816e38bf tempest-ServerRescueTestJSON-511512233 tempest-ServerRescueTestJSON-511512233-project-member] Enqueued Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1427.512449] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1427.512735] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.512895] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.512961] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.513366] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.513479] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.513581] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.513645] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.513797] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.513878] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.513969] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.016942] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.518866] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.021612] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.021910] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.021952] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.022269] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.022406] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.022557] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9c831b-b891-45f9-ba30-065286c9f41e is going to be updated. [ 1429.051987] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.052158] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.052277] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.052413] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.052557] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.062204] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: IN_PROGRESS for 2s [ 1431.072343] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: SUCCESS [ 1431.072757] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.513813] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1432.514229] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.107151] env[69777]: INFO networking_nsxv3.common.synchronization [req-ec077713-8ff4-4bb7-9208-c3086c5634e9 req-35f13f36-583f-4ee2-9f9c-e96ddb85398f tempest-ServerRescueTestJSON-511512233 tempest-ServerRescueTestJSON-511512233-project-member] Enqueued Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1434.107737] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9c831b-b891-45f9-ba30-065286c9f41e with Priority: HIGHEST for action security_group_members [ 1434.107944] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9c831b-b891-45f9-ba30-065286c9f41e taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.108187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.108187] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.109033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.109033] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.109033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.109033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.109033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.109033] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.109033] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9c831b-b891-45f9-ba30-065286c9f41e',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.611166] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.611368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.611368] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.611587] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.635814] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.636072] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.636197] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.636252] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.636485] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.636576] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.636667] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9c831b-b891-45f9-ba30-065286c9f41e is going to be updated. [ 1434.660986] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.661137] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.661201] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.661404] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.661531] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.668865] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: IN_PROGRESS for 2s [ 1436.687135] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9c831b-b891-45f9-ba30-065286c9f41e in Status: SUCCESS [ 1436.687135] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9c831b-b891-45f9-ba30-065286c9f41e deletion is rescheduled due to dependency. [ 1436.687135] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9c831b-b891-45f9-ba30-065286c9f41e" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.108836] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.108836] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.109877] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.110238] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.111381] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.111716] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.112615] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.113053] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.114149] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.114519] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.115129] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.115474] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.116334] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.116702] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.073352] env[69777]: INFO networking_nsxv3.common.synchronization [req-9c4d54bf-9611-4b9a-b0db-acd7935c4055 req-4ab74762-09d3-47b3-8f15-82cc8c4019f1 tempest-AttachVolumeTestJSON-202711453 tempest-AttachVolumeTestJSON-202711453-project-member] Enqueued Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_members [ 1474.073896] env[69777]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc with Priority: HIGHEST for action security_group_members [ 1474.074264] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock member-484efcb5-0d6f-4695-805f-26ba73a7b1fc taken with stack trace [, , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.074401] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.074473] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.074667] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.074819] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.074918] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.074981] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.075262] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.075357] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.075455] env[69777]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('484efcb5-0d6f-4695-805f-26ba73a7b1fc',) {} {{(pid=69777) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.577417] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.577690] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.577690] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.577839] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.599106] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.599365] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.599483] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.599553] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.599756] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.599841] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.599930] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc is going to be updated. [ 1474.626417] env[69777]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69777) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.626625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.626625] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.626811] env[69777]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.626954] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.634554] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc in Status: IN_PROGRESS for 2s [ 1476.645377] env[69777]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc in Status: SUCCESS [ 1476.645820] env[69777]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 484efcb5-0d6f-4695-805f-26ba73a7b1fc deletion is rescheduled due to dependency. [ 1476.645820] env[69777]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-484efcb5-0d6f-4695-805f-26ba73a7b1fc" {{(pid=69777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.075295] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.075715] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.076608] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.077038] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.077390] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.077762] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.078467] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.078801] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.079910] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1499.080325] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1504.080704] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.080991] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.081640] env[69777]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.081989] env[69777]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0